2020-07-05T13:15:48.313 INFO:root:teuthology version: 1.0.0-2b31d02
2020-07-05T13:15:48.320 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-07-05T13:15:48.697 INFO:root:teuthology version: 1.0.0-2b31d02
2020-07-05T13:15:48.700 INFO:teuthology.results:subset: '27/9999'
2020-07-05T13:15:48.700 INFO:teuthology.results:seed: '1308'
2020-07-05T17:49:53.085 INFO:teuthology.results:Tests finished! gathering results...
2020-07-05T17:49:54.800 INFO:scrape:Found 24 jobs
2020-07-05T17:49:57.517 INFO:scrape:Found 4 distinct failure reasons
2020-07-05T17:49:57.518 INFO:scrape:Failure: "2020-07-05T14:42:02.992226+0000 mds.c (mds.3) 1 : cluster [WRN] client.4457 isn't responding to mclientcaps(revoke), ino 0x4000000236b pending pAsLsXs issued pAsLsXsFsx, sent 61.529880 seconds ago" in cluster log
2020-07-05T17:49:57.518 INFO:scrape:1 jobs: ['5199936']
2020-07-05T17:49:57.519 INFO:scrape:suites: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-07-05T17:49:57.519 INFO:scrape:
2020-07-05T17:49:57.520 INFO:scrape:Failure: Command failed on smithi131 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
2020-07-05T17:49:57.520 INFO:scrape:4 jobs: ['5199910', '5199918', '5199902', '5199938']
2020-07-05T17:49:57.521 INFO:scrape:suites intersection: ['begin', 'conf/{client', 'mds', 'mon', 'osd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-05T17:49:57.521 INFO:scrape:suites union: ['begin', 'ceph-thrash/mon', 'clusters/3-mds', 'clusters/3-mds-2-standby', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/thrash/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_misc}', 'tasks/cfuse_workunit_suites_blogbench}', 'tasks/cfuse_workunit_suites_ffsb}', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-05T17:49:57.522 INFO:scrape:
2020-07-05T17:49:57.522 INFO:scrape:Timeout 3h running clone.client.1/qa/workunits/kernel_untar_build.sh
2020-07-05T17:49:57.522 INFO:scrape:1 jobs: ['5199942']
2020-07-05T17:49:57.523 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mount/fuse', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_kernel_untar_build}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-05T17:49:57.523 INFO:scrape:
2020-07-05T17:49:57.524 INFO:scrape:Failure: Command failed on smithi085 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0'
2020-07-05T17:49:57.524 INFO:scrape:1 jobs: ['5199926']
2020-07-05T17:49:57.525 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mount/fuse', 'multimds/basic/{0-supported-random-distro$/{centos_latest}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_fsx}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-05T17:49:57.525 INFO:scrape:
2020-07-05T17:49:57.527 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/
failed:  7
dead:    0
running: 0
waiting: 0
queued:  0
passed:  17


Fail
=================================================================
[5199902]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
-----------------------------------------------------------------
time:   00:03:05
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199902/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199902/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=053f8e8e7be948a9867eeea7c51f02cc

    Command failed on smithi043 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel
    bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel
    xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel
    libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-
    devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex
    elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

[5199910]  multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   00:03:44
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199910/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199910/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=dca8bd1f688445079115753d68baa9a8

    Command failed on smithi131 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel
    bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel
    xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel
    libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-
    devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex
    elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

[5199918]  multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   00:03:02
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199918/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199918/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9e6b502134d248aa9f4873aae7e76708

    Command failed on smithi019 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel
    bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel
    xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel
    libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-
    devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex
    elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

[5199926]  multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:50:35
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199926/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199926/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=593133cdba6041fcb7510eae193b2baa

    Command failed on smithi085 with status 1: 'sudo rm -rf --
    /home/ubuntu/cephtest/workunits.list.client.0
    /home/ubuntu/cephtest/clone.client.0'

[5199936]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:12:17
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199936/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199936/

    "2020-07-05T14:42:02.992226+0000 mds.c (mds.3) 1 : cluster [WRN]
    client.4457 isn't responding to mclientcaps(revoke), ino 0x4000000236b
    pending pAsLsXs issued pAsLsXsFsx, sent 61.529880 seconds ago" in cluster
    log

[5199938]  multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:03:04
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199938/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199938/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=37bead17b27d4bfd9b4808217cfe1788

    Command failed on smithi094 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel
    bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel
    xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel
    xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel
    libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-
    devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex
    elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel
    libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool
    libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel
    libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump
    xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'

[5199942]  multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   04:12:24
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199942/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199942/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9f4c00f30e2f46448f5440a493f4baf8

    Command failed (workunit test kernel_untar_build.sh) on smithi110 with
    status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=5a3693ca1e7148b0365557740d6f70f3db8cd0e8
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'



Pass
=================================================================
[5199899] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:09:29
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199899/

[5199904] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:02
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199904/

[5199906] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:24:56
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199906/

[5199907] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:24:17
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199907/

[5199912] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:06:06
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199912/

[5199914] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:21:51
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199914/

[5199916] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:11:45
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199916/

[5199920] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:36:00
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199920/

[5199922] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:36
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199922/

[5199924] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:23:48
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199924/

[5199928] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:05:12
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199928/

[5199930] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:21:15
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199930/

[5199932] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:22:10
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199932/

[5199934] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:02
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199934/

[5199940] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:24:45
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199940/

[5199944] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:23:22
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199944/

[5199946] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:22:06
info:   http://pulpito.ceph.com/teuthology-2020-07-05_13:15:02-multimds-octopus-testing-basic-smithi/5199946/