2020-10-06T23:06:11.498 INFO:root:teuthology version: 1.0.0-2cf4b81
2020-10-06T23:06:11.501 INFO:teuthology.results:subset: '1/10'
2020-10-06T23:06:11.501 INFO:teuthology.results:seed: '2349'
2020-10-07T01:29:31.341 INFO:root:teuthology version: 1.0.0-2cf4b81
2020-10-07T01:29:31.698 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-10-07T03:38:34.664 INFO:teuthology.results:Tests finished! gathering results...
2020-10-07T03:38:49.559 INFO:scrape:Found 128 jobs
2020-10-07T03:38:55.121 INFO:scrape:Found 6 distinct failure reasons
2020-10-07T03:38:55.122 INFO:scrape:Failure: Command failed on smithi058 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
2020-10-07T03:38:55.122 INFO:scrape:1 jobs: ['5499511']
2020-10-07T03:38:55.123 INFO:scrape:suites: ['begin', 'ceph-thrash/mds', 'clusters/3-mds-2-standby', 'conf/{client', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-07T03:38:55.123 INFO:scrape:
2020-10-07T03:38:55.123 INFO:scrape:Failure: Command failed (workunit test suites/fsstress.sh) on smithi144 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=74a8666ad1c5dcdfa42b692f3d0c31d13d8d1fd0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'
2020-10-07T03:38:55.124 INFO:scrape:3 jobs: ['5499463', '5499495', '5499527']
2020-10-07T03:38:55.124 INFO:scrape:suites intersection: ['begin', 'ceph-thrash/mds', 'clusters/3-mds-2-standby', 'conf/{client', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-07T03:38:55.124 INFO:scrape:suites union: ['begin', 'ceph-thrash/mds', 'clusters/3-mds-2-standby', 'conf/{client', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{centos_latest}', 'multimds/thrash/{0-supported-random-distro$/{rhel_latest}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-07T03:38:55.125 INFO:scrape:
2020-10-07T03:38:55.125 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds
2020-10-07T03:38:55.125 INFO:scrape:1 jobs: ['5499385']
2020-10-07T03:38:55.125 INFO:scrape:suites: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-10-07T03:38:55.126 INFO:scrape:
2020-10-07T03:38:55.126 INFO:scrape:Failure: Command failed on smithi083 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev'
2020-10-07T03:38:55.126 INFO:scrape:1 jobs: ['5499453']
2020-10-07T03:38:55.127 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_kernel_untar_build}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-07T03:38:55.127 INFO:scrape:
2020-10-07T03:38:55.127 INFO:scrape:Crash: "2020-10-07T01:19:23.451461+0000 mon.b (mon.0) 216 : cluster [WRN] Replacing daemon mds.j as rank 0 with standby daemon mds.h" in cluster log
2020-10-07T03:38:55.128 INFO:scrape:ceph version 15.2.5-238-g74a8666a (74a8666ad1c5dcdfa42b692f3d0c31d13d8d1fd0) octopus (stable)
 1: (()+0x12dc0) [0x7fa889dcddc0]
 2: (gsignal()+0x10f) [0x7fa888aa38df]
 3: (abort()+0x127) [0x7fa888a8dcf5]
 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7fa88c2cd5a5]
 5: (()+0x27a76e) [0x7fa88c2cd76e]
 6: (Monitor::~Monitor()+0xe52) [0x559bae66ecc2]
 7: (Monitor::~Monitor()+0xd) [0x559bae66ed3d]
 8: (main()+0x565e) [0x559bae60162e]
 9: (__libc_start_main()+0xf3) [0x7fa888a8f873]
 10: (_start()+0x2e) [0x559bae62aeae]
2020-10-07T03:38:55.128 INFO:scrape:1 jobs: ['5499551']
2020-10-07T03:38:55.128 INFO:scrape:suites: ['begin', 'ceph-thrash/mon', 'clusters/9-mds-3-standby', 'conf/{client', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multimds/thrash/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{fuse-default-perm-no', 'rhel_8}', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-07T03:38:55.128 INFO:scrape:
2020-10-07T03:38:55.129 INFO:scrape:Failure: "2020-10-07T01:31:09.517393+0000 mds.e (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi061: (4731), after waiting 46.0189 seconds during MDS startup" in cluster log
2020-10-07T03:38:55.129 INFO:scrape:1 jobs: ['5499559']
2020-10-07T03:38:55.129 INFO:scrape:suites: ['begin', 'ceph-thrash/mds', 'clusters/3-mds-2-standby', 'conf/{client', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{rhel_latest}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-10-07T03:38:55.130 INFO:scrape:
2020-10-07T03:38:55.136 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/
failed:  8
dead:    0
running: 0
waiting: 0
queued:  0
passed:  120


Fail
=================================================================
[5499385]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   01:57:42
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499385/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499385/

    reached maximum tries (50) after waiting for 300 seconds

[5499453]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   00:05:52
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499453/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499453/
sentry: https://sentry.ceph.com/sentry/sepia/?query=da4cc6844bdc49beb49b836574f6b9e4

    Command failed on smithi083 with status 100: 'sudo
    DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="
    --force-confdef" -o Dpkg::Options::="--force-confold" install bison flex
    libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-
    dev'

[5499463]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:11:50
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499463/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499463/
sentry: https://sentry.ceph.com/sentry/sepia/?query=41ac2777fb3940fca292e209ffd37816

    Command failed (workunit test suites/fsstress.sh) on smithi144 with status
    2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=74a8666ad1c5dcdfa42b692f3d0c31d13d8d1fd0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

[5499495]  multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   02:36:18
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499495/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499495/
sentry: https://sentry.ceph.com/sentry/sepia/?query=5a7880a415a4439cbfee7be99ebe9841

    Command failed (workunit test suites/fsstress.sh) on smithi196 with status
    2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=74a8666ad1c5dcdfa42b692f3d0c31d13d8d1fd0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

[5499511]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:03:24
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499511/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499511/
sentry: https://sentry.ceph.com/sentry/sepia/?query=b51c673593e14bfcb39a86795f7a9150

    Command failed on smithi058 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel
    bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel
    xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel
    libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-
    devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex
    elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

[5499527]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   01:12:59
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499527/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499527/
sentry: https://sentry.ceph.com/sentry/sepia/?query=d2ae232abaf442b79fd42884ae9dcbd8

    Command failed (workunit test suites/fsstress.sh) on smithi197 with status
    2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=74a8666ad1c5dcdfa42b692f3d0c31d13d8d1fd0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

[5499551]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:26:05
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499551/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499551/

    "2020-10-07T01:19:23.451461+0000 mon.b (mon.0) 216 : cluster [WRN]
    Replacing daemon mds.j as rank 0 with standby daemon mds.h" in cluster log

[5499559]  multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   02:06:11
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499559/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499559/

    "2020-10-07T01:31:09.517393+0000 mds.e (mds.0) 1 : cluster [WRN] evicting
    unresponsive client smithi061: (4731), after waiting 46.0189 seconds during
    MDS startup" in cluster log



Pass
=================================================================
[5499349] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:39:21
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499349/

[5499351] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:11:45
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499351/

[5499353] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:05:42
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499353/

[5499355] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:24:06
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499355/

[5499357] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:11:26
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499357/

[5499359] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:37
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499359/

[5499361] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:56:00
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499361/

[5499363] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:12:50
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499363/

[5499365] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:34:08
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499365/

[5499367] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:07
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499367/

[5499369] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:53:45
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499369/

[5499371] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:25:27
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499371/

[5499373] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499373/

[5499375] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:54
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499375/

[5499377] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:21:33
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499377/

[5499379] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:12:17
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499379/

[5499381] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:29
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499381/

[5499383] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:09:28
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499383/

[5499387] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:30
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499387/

[5499389] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:53:36
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499389/

[5499391] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:47
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499391/

[5499393] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:44:37
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499393/

[5499395] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:10
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499395/

[5499397] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:22:37
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499397/

[5499399] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:31
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499399/

[5499401] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:57:43
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499401/

[5499403] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:23:00
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499403/

[5499405] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:15:56
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499405/

[5499407] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:01
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499407/

[5499409] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:39:51
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499409/

[5499411] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:11:08
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499411/

[5499413] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:40:55
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499413/

[5499415] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:39
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499415/

[5499417] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:13:08
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499417/

[5499419] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:20
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499419/

[5499421] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:03:29
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499421/

[5499423] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:58
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499423/

[5499425] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:50:22
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499425/

[5499427] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:13:33
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499427/

[5499429] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:29:42
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499429/

[5499431] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:20:17
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499431/

[5499433] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:04:23
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499433/

[5499435] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:22
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499435/

[5499437] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:09
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499437/

[5499439] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:16
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499439/

[5499441] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:20:02
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499441/

[5499443] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:10:17
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499443/

[5499445] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:44
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499445/

[5499447] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:16
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499447/

[5499449] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:53:17
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499449/

[5499451] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:24:36
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499451/

[5499455] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:22
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499455/

[5499457] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:43:39
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499457/

[5499459] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:13:04
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499459/

[5499461] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:35:19
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499461/

[5499465] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:56:04
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499465/

[5499467] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:07:53
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499467/

[5499469] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:15:13
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499469/

[5499471] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:45
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499471/

[5499473] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:21:30
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499473/

[5499475] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:28:18
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499475/

[5499477] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:37:37
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499477/

[5499479] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:54
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499479/

[5499481] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:13:39
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499481/

[5499483] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:25:48
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499483/

[5499485] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:54:10
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499485/

[5499487] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:43
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499487/

[5499489] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:45:38
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499489/

[5499491] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499491/

[5499493] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:32:52
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499493/

[5499497] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:04:03
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499497/

[5499499] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:28:34
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499499/

[5499501] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:14:40
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499501/

[5499503] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:34
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499503/

[5499505] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:40:11
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499505/

[5499507] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:39:55
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499507/

[5499509] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:23
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499509/

[5499513] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:53:33
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499513/

[5499515] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:48
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499515/

[5499517] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:42:01
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499517/

[5499519] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:10
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499519/

[5499521] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:12:16
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499521/

[5499523] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:12:48
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499523/

[5499525] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:20:26
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499525/

[5499529] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:54:40
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499529/

[5499531] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:26:44
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499531/

[5499533] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:14
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499533/

[5499535] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:05
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499535/

[5499537] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:29:42
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499537/

[5499539] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:11:52
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499539/

[5499541] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:39:54
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499541/

[5499543] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:22
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499543/

[5499545] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:14:16
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499545/

[5499547] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:06
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499547/

[5499549] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:24:24
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499549/

[5499553] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:40:44
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499553/

[5499555] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499555/

[5499557] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:30:43
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499557/

[5499561] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:48:51
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499561/

[5499563] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:53:10
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499563/

[5499565] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:15:42
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499565/

[5499567] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:11:52
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499567/

[5499569] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:32:10
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499569/

[5499571] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:09:49
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499571/

[5499573] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:25
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499573/

[5499575] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:09:31
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499575/

[5499577] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:51:45
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499577/

[5499579] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:59
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499579/

[5499581] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:44:28
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499581/

[5499583] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:33
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499583/

[5499585] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:59:44
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499585/

[5499587] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:12:51
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499587/

[5499589] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:32:34
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499589/

[5499591] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:14
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499591/

[5499593] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:55:08
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499593/

[5499595] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:35:37
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499595/

[5499597] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:42
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499597/

[5499599] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:13:35
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499599/

[5499600] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:20:39
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499600/

[5499601] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:11:26
info:   http://pulpito.ceph.com/yuriw-2020-10-05_21:27:40-multimds-wip-yuri6-testing-2020-10-05-1025-octopus-distro-basic-smithi/5499601/