2020-07-11T07:44:37.502 INFO:root:teuthology version: 1.0.0-da68153
2020-07-11T07:44:37.504 INFO:teuthology.results:subset: '3/4'
2020-07-11T07:44:37.504 INFO:teuthology.results:seed: '841'
2020-07-11T12:51:40.792 INFO:root:teuthology version: 1.0.0-da68153
2020-07-11T12:51:40.824 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-07-11T23:38:04.243 INFO:teuthology.results:Tests finished! gathering results...
2020-07-11T23:38:32.570 INFO:scrape:Found 320 jobs
2020-07-11T23:38:46.219 INFO:scrape:Found 10 distinct failure reasons
2020-07-11T23:38:46.222 INFO:scrape:Failure: Command failed on smithi137 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel'
2020-07-11T23:38:46.222 INFO:scrape:2 jobs: ['5214673', '5214508']
2020-07-11T23:38:46.223 INFO:scrape:suites intersection: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.224 INFO:scrape:suites union: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cephfs_test_snapshots}', 'tasks/cfuse_workunit_suites_blogbench}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.224 INFO:scrape:
2020-07-11T23:38:46.224 INFO:scrape:Failure: Command failed (workunit test suites/fsstress.sh) on smithi155 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'
2020-07-11T23:38:46.225 INFO:scrape:2 jobs: ['5214443', '5214610']
2020-07-11T23:38:46.225 INFO:scrape:suites intersection: ['conf/{client', 'mds', 'mon', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{fuse-default-perm-no', 'whitelist_health']
2020-07-11T23:38:46.226 INFO:scrape:suites union: ['begin', 'centos_latest', 'ceph-thrash/mon', 'clusters/3-mds', 'clusters/9-mds-3-standby', 'conf/{client', 'k-testing}', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{ubuntu_latest}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'whitelist_wrongly_marked_down}}']
2020-07-11T23:38:46.227 INFO:scrape:
2020-07-11T23:38:46.227 INFO:scrape:Failure: "2020-07-11T11:59:13.024353+0000 mon.b (mon.0) 165 : cluster [WRN] Health check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster log
2020-07-11T23:38:46.227 INFO:scrape:1 jobs: ['5214660']
2020-07-11T23:38:46.228 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'q_check_counter/check_counter', 'rhel_8}', 'tasks/cfuse_workunit_suites_ffsb}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.228 INFO:scrape:
2020-07-11T23:38:46.229 INFO:scrape:Dead: b'2020-07-11T23:35:41.306 DEBUG:teuthology.exit:Finished running handlers'
2020-07-11T23:38:46.229 INFO:scrape:1 jobs: ['5214658']
2020-07-11T23:38:46.230 INFO:scrape:suites: ['begin', 'ceph-thrash/mon', 'clusters/9-mds-3-standby', 'conf/{client', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{rhel_8}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.230 INFO:scrape:
2020-07-11T23:38:46.231 INFO:scrape:Timeout 3h running clone.client.1/qa/workunits/fs/norstats/kernel_untar_tar.sh
2020-07-11T23:38:46.231 INFO:scrape:1 jobs: ['5214480']
2020-07-11T23:38:46.231 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/stock/{k-stock', 'q_check_counter/check_counter', 'rhel_8}', 'tasks/cfuse_workunit_norstats}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.232 INFO:scrape:
2020-07-11T23:38:46.232 INFO:scrape:Failure: {'Failure object was': {'smithi169.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost-random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}
2020-07-11T23:38:46.233 INFO:scrape:1 jobs: ['5214679']
2020-07-11T23:38:46.233 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_fsx}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.234 INFO:scrape:
2020-07-11T23:38:46.234 INFO:scrape:Timeout 3h running clone.client.1/qa/workunits/kernel_untar_build.sh
2020-07-11T23:38:46.235 INFO:scrape:1 jobs: ['5214493']
2020-07-11T23:38:46.235 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_kernel_untar_build}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.236 INFO:scrape:
2020-07-11T23:38:46.236 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/suites/ffsb.sh
2020-07-11T23:38:46.236 INFO:scrape:1 jobs: ['5214452']
2020-07-11T23:38:46.237 INFO:scrape:suites: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_ffsb}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.237 INFO:scrape:
2020-07-11T23:38:46.238 INFO:scrape:Failure: Command failed (workunit test suites/pjd.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh'
2020-07-11T23:38:46.238 INFO:scrape:2 jobs: ['5214696', '5214616']
2020-07-11T23:38:46.239 INFO:scrape:suites intersection: ['begin', 'conf/{client', 'fuse-default-perm-no}', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_pjd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.239 INFO:scrape:suites union: ['begin', 'clusters/3-mds', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'inline/yes', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_suites_pjd}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-07-11T23:38:46.240 INFO:scrape:
2020-07-11T23:38:46.240 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds
2020-07-11T23:38:46.241 INFO:scrape:2 jobs: ['5214475', '5214571']
2020-07-11T23:38:46.241 INFO:scrape:suites intersection: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-07-11T23:38:46.241 INFO:scrape:suites union: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-07-11T23:38:46.242 INFO:scrape:
2020-07-11T23:38:46.262 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/
failed:  12
dead:    2
running: 0
waiting: 0
queued:  0
passed:  306


Fail
=================================================================
[5214443]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:14:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214443/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214443/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5a7d1369161c42e0b1450e85234d29a3

    Command failed (workunit test suites/fsstress.sh) on smithi155 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

[5214452]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   03:35:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214452/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214452/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=daf2655dbd0c40469a1f2e5473611316

    Command failed (workunit test suites/ffsb.sh) on smithi080 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh'

[5214475]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   03:12:31
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214475/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214475/

    reached maximum tries (50) after waiting for 300 seconds

[5214480]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
-----------------------------------------------------------------
time:   03:18:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214480/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214480/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1d57d25db9724a75bdfb9da7a02f5d15

    Command failed (workunit test fs/norstats/kernel_untar_tar.sh) on smithi107
    with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp &&
    cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp &&
    CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.1/qa/workunits/fs/norstats/kernel_untar_tar.sh'

[5214493]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   03:29:16
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214493/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214493/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2e3ad2111485410cbb708e414c0edaac

    Command failed (workunit test kernel_untar_build.sh) on smithi079 with
    status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/kernel_untar_build.sh'

[5214508]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
-----------------------------------------------------------------
time:   00:03:42
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214508/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214508/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=405edee34a1f4acf90be890387f3f340

    Command failed on smithi050 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-
    devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel
    libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel'

[5214571]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:41:42
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214571/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214571/

    reached maximum tries (50) after waiting for 300 seconds

[5214610]  multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   03:41:38
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214610/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214610/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=e671fac03dcf40138c156dc6037b6243

    Command failed (workunit test suites/fsstress.sh) on smithi057 with status
    2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh'

[5214616]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:15:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214616/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214616/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=80a1bc85c059400eb5925bf31ed4ca27

    Command failed (workunit test suites/pjd.sh) on smithi167 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd --
    /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/pjd.sh'

[5214660]  multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   02:41:35
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214660/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214660/

    "2020-07-11T11:59:13.024353+0000 mon.b (mon.0) 165 : cluster [WRN] Health
    check failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in
    cluster log

[5214673]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
-----------------------------------------------------------------
time:   00:04:34
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214673/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214673/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5e2652440e1a42d98c071fb71b687253

    Command failed on smithi137 with status 1: 'sudo yum -y install ceph-
    radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-
    mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-
    mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2
    librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-
    mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-
    devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-
    devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel
    libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel
    openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel
    libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-
    devel libtool libuuid-devel xfsprogs-devel'

[5214696]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
-----------------------------------------------------------------
time:   00:16:09
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214696/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214696/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=567d52cabf7d44fba92c781a7ec21e0b

    Command failed (workunit test suites/pjd.sh) on smithi137 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=a3fd73ca0eb7b6e83d6ad9ba0c506359f9f289cb
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/pjd.sh'



Dead
=================================================================
[5214658]  multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214658/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214658/

[5214679]  multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
-----------------------------------------------------------------
time:   00:04:27
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214679/
log:    http://qa-proxy.ceph.com/teuthology/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214679/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=0e7a4a46390d46f8a9e59cd7727ff6f3

    {'Failure object was': {'smithi169.front.sepia.ceph.com': {'msg': 'Failed
    to download packages: Cannot download Packages/boost-
    random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [],
    'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit',
    'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs',
    'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof',
    'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel',
    'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose',
    'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-
    kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'],
    'state': 'present', 'allow_downgrade': False, 'autoremove': False,
    'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [],
    'disablerepo': [], 'download_only': False, 'enable_plugin': [],
    'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery':
    True, 'install_weak_deps': True, 'security': False, 'skip_broken': False,
    'update_cache': False, 'update_only': False, 'validate_certs': True,
    'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None',
    'download_dir': 'None', 'list': 'None', 'releasever': 'None'}},
    '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call
    last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-
    ansible_master/callback_plugins/failure_log.py", line 44, in log_failure
    log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data],
    stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com
    _git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data)
    File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l
    ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node
    = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te
    uthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 48, in represent_data node =
    self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s
    rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 207, in represent_dict return
    self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo
    rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 118, in represent_mapping node_value =
    self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi
    t_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 58, in represent_data node =
    self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce
    ph.com_git_teuthology_master/virtualenv/lib/python3.6/site-
    packages/yaml/representer.py", line 231, in represent_undefined raise
    RepresenterError("cannot represent an object", data)',
    'yaml.representer.RepresenterError': "('cannot represent an object', '/')"}



Pass
=================================================================
[5214425] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214425/

[5214426] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214426/

[5214427] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:00:53
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214427/

[5214428] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214428/

[5214429] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:12:47
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214429/

[5214430] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:08
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214430/

[5214431] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:52:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214431/

[5214432] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:15:50
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214432/

[5214433] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:32:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214433/

[5214434] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214434/

[5214435] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:59:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214435/

[5214436] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:36:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214436/

[5214437] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:00
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214437/

[5214438] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214438/

[5214439] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:25:27
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214439/

[5214440] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:15:28
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214440/

[5214441] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:40:50
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214441/

[5214442] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:40
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214442/

[5214444] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:27:16
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214444/

[5214445] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:03:20
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214445/

[5214446] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:37
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214446/

[5214447] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:45:40
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214447/

[5214448] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:14:48
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214448/

[5214449] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:29:43
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214449/

[5214450] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214450/

[5214451] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:02:55
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214451/

[5214453] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:16:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214453/

[5214454] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:12
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214454/

[5214455] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:28:30
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214455/

[5214456] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:19:09
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214456/

[5214457] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214457/

[5214458] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214458/

[5214459] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:00:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214459/

[5214460] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:26
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214460/

[5214461] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:18:37
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214461/

[5214462] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214462/

[5214463] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:46:56
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214463/

[5214464] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:19:38
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214464/

[5214465] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:28:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214465/

[5214466] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214466/

[5214467] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:01:45
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214467/

[5214468] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:22
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214468/

[5214469] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:19:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214469/

[5214470] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214470/

[5214471] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:40:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214471/

[5214472] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:12:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214472/

[5214473] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:45:05
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214473/

[5214474] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214474/

[5214476] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:21:42
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214476/

[5214477] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:44:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214477/

[5214478] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:55
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214478/

[5214479] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:14:22
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214479/

[5214481] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:44:10
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214481/

[5214482] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214482/

[5214483] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:50:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214483/

[5214484] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:37:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214484/

[5214485] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:22:52
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214485/

[5214486] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:12
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214486/

[5214487] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:24:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214487/

[5214488] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:14:43
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214488/

[5214489] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:40
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214489/

[5214490] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214490/

[5214491] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   00:56:58
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214491/

[5214492] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214492/

[5214494] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:18:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214494/

[5214495] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:41:19
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214495/

[5214496] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:18:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214496/

[5214497] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:34:03
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214497/

[5214498] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:11
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214498/

[5214499] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:01:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214499/

[5214500] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:51:31
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214500/

[5214501] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214501/

[5214502] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:08
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214502/

[5214503] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:35:43
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214503/

[5214504] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:15:33
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214504/

[5214505] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:40:35
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214505/

[5214506] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:18:02
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214506/

[5214507] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:35:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214507/

[5214509] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:48:59
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214509/

[5214510] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:27:08
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214510/

[5214511] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:06:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214511/

[5214512] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:13:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214512/

[5214513] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:30:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214513/

[5214514] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214514/

[5214515] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:13:48
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214515/

[5214516] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214516/

[5214517] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:19:35
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214517/

[5214518] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:25:15
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214518/

[5214519] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:26:37
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214519/

[5214520] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214520/

[5214521] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:23
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214521/

[5214522] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214522/

[5214523] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:09:26
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214523/

[5214524] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:50
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214524/

[5214525] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:30:28
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214525/

[5214526] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:49
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214526/

[5214527] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:43:19
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214527/

[5214528] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214528/

[5214529] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:34:42
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214529/

[5214530] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:09
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214530/

[5214531] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:03:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214531/

[5214532] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   02:01:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214532/

[5214533] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214533/

[5214534] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:59
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214534/

[5214535] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:24:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214535/

[5214536] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214536/

[5214537] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:44:06
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214537/

[5214538] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:28
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214538/

[5214539] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:51:53
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214539/

[5214540] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:11
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214540/

[5214541] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:42:10
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214541/

[5214542] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:24:26
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214542/

[5214543] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:24:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214543/

[5214544] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:19:16
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214544/

[5214545] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:38:03
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214545/

[5214546] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214546/

[5214547] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:01:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214547/

[5214548] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:28
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214548/

[5214549] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:19:52
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214549/

[5214550] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:34
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214550/

[5214551] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:41:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214551/

[5214552] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:31:11
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214552/

[5214553] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214553/

[5214554] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:12:56
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214554/

[5214555] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:06:20
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214555/

[5214556] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214556/

[5214557] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:09:59
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214557/

[5214558] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:25:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214558/

[5214559] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:50:10
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214559/

[5214560] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:20:33
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214560/

[5214561] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:36:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214561/

[5214562] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:11
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214562/

[5214563] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:58:16
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214563/

[5214564] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:30:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214564/

[5214565] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:20:09
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214565/

[5214566] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214566/

[5214567] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:25:59
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214567/

[5214568] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:16:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214568/

[5214569] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:40:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214569/

[5214570] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214570/

[5214572] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:32:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214572/

[5214573] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:06:40
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214573/

[5214574] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:26:06
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214574/

[5214575] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:56:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214575/

[5214576] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:15:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214576/

[5214577] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:22:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214577/

[5214578] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:26
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214578/

[5214579] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:05:20
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214579/

[5214580] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:42:54
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214580/

[5214581] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214581/

[5214582] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:28
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214582/

[5214583] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:44:05
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214583/

[5214584] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214584/

[5214585] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:22
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214585/

[5214586] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:27
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214586/

[5214587] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:19:02
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214587/

[5214588] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:20
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214588/

[5214589] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:23:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214589/

[5214590] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:27
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214590/

[5214591] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:01:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214591/

[5214592] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:06
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214592/

[5214593] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:27:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214593/

[5214594] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:13
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214594/

[5214595] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:05:43
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214595/

[5214596] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:45:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214596/

[5214597] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214597/

[5214598] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:20
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214598/

[5214599] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:21:43
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214599/

[5214600] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:34
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214600/

[5214601] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:45:23
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214601/

[5214602] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:56
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214602/

[5214603] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:58:42
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214603/

[5214604] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:21:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214604/

[5214605] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:59:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214605/

[5214606] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:58
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214606/

[5214607] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:02:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214607/

[5214608] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:17:56
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214608/

[5214609] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:43:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214609/

[5214611] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:56:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214611/

[5214612] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:24:08
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214612/

[5214613] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:20:55
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214613/

[5214614] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:33
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214614/

[5214615] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:23:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214615/

[5214617] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:44:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214617/

[5214618] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214618/

[5214619] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:19:02
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214619/

[5214620] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:59
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214620/

[5214621] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:59:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214621/

[5214622] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214622/

[5214623] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:40:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214623/

[5214624] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:20:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214624/

[5214625] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:32:23
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214625/

[5214626] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:13
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214626/

[5214627] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:02:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214627/

[5214628] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:29:00
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214628/

[5214629] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:26
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214629/

[5214630] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214630/

[5214631] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:40:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214631/

[5214632] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:35:31
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214632/

[5214633] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214633/

[5214634] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:30
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214634/

[5214635] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:58:33
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214635/

[5214636] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:26:22
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214636/

[5214637] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:48:32
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214637/

[5214638] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:55
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214638/

[5214639] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:23:48
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214639/

[5214640] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:19
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214640/

[5214641] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:26:42
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214641/

[5214642] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214642/

[5214643] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:58:33
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214643/

[5214644] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:30:55
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214644/

[5214645] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:20:35
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214645/

[5214646] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:27
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214646/

[5214647] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:33:48
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214647/

[5214648] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:02
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214648/

[5214649] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214649/

[5214650] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214650/

[5214651] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:18:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214651/

[5214652] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214652/

[5214653] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:30:37
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214653/

[5214654] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:36
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214654/

[5214655] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:48:12
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214655/

[5214656] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:17:47
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214656/

[5214657] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:27:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214657/

[5214659] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:52:55
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214659/

[5214661] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:18:04
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214661/

[5214662] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214662/

[5214663] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:37:15
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214663/

[5214664] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:13:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214664/

[5214665] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:45:18
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214665/

[5214666] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:18:37
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214666/

[5214667] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:57:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214667/

[5214668] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:21:04
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214668/

[5214669] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:46:21
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214669/

[5214670] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:20:15
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214670/

[5214671] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:14:34
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214671/

[5214672] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:18:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214672/

[5214674] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:09
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214674/

[5214675] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:58:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214675/

[5214676] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:36:23
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214676/

[5214677] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:20:57
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214677/

[5214678] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:45
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214678/

[5214680] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:14:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214680/

[5214681] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:42:15
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214681/

[5214682] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214682/

[5214683] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:00
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214683/

[5214684] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:33
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214684/

[5214685] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:21:38
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214685/

[5214686] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:40
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214686/

[5214687] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:38:30
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214687/

[5214688] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:20:15
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214688/

[5214689] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:38:19
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214689/

[5214690] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:39
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214690/

[5214691] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:04:38
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214691/

[5214692] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:40:34
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214692/

[5214693] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:19
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214693/

[5214694] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:17:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214694/

[5214695] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:25:52
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214695/

[5214697] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:00
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214697/

[5214698] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:54
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214698/

[5214699] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:56:38
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214699/

[5214700] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:27:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214700/

[5214701] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:43:50
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214701/

[5214702] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:41
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214702/

[5214703] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:45:59
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214703/

[5214704] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214704/

[5214705] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:27:11
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214705/

[5214706] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:13
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214706/

[5214707] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:07:05
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214707/

[5214708] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:31:38
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214708/

[5214709] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:16:22
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214709/

[5214710] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:43
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214710/

[5214711] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:46:18
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214711/

[5214712] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:18:16
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214712/

[5214713] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:43:47
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214713/

[5214714] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214714/

[5214715] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:20:18
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214715/

[5214716] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:18:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214716/

[5214717] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:15:17
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214717/

[5214718] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:49
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214718/

[5214719] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:06:14
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214719/

[5214720] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:17:15
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214720/

[5214721] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:31:25
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214721/

[5214722] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:02
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214722/

[5214723] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:57:50
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214723/

[5214724] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:40:10
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214724/

[5214725] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:22:06
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214725/

[5214726] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:22
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214726/

[5214727] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:25:47
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214727/

[5214728] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:12:47
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214728/

[5214729] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:44:24
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214729/

[5214730] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:31
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214730/

[5214731] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:55:52
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214731/

[5214732] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:22:02
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214732/

[5214733] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:00:44
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214733/

[5214734] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:31
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214734/

[5214735] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:11:23
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214735/

[5214736] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:21:01
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214736/

[5214737] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:35:51
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214737/

[5214738] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:07
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214738/

[5214739] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:53:10
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214739/

[5214740] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:09:57
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214740/

[5214741] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:29
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214741/

[5214742] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:46
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214742/

[5214743] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:34:03
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214743/

[5214744] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:14:23
info:   http://pulpito.ceph.com/pdonnell-2020-07-11_02:49:10-multimds-wip-pdonnell-testing-20200711.001802-distro-basic-smithi/5214744/