2020-08-27T06:05:38.366 INFO:root:teuthology version: 1.0.0-8271c95 2020-08-27T06:05:38.368 INFO:teuthology.results:subset: '16/9999' 2020-08-27T06:05:38.368 INFO:teuthology.results:seed: '9430' 2020-08-27T06:17:23.060 INFO:root:teuthology version: 1.0.0-8271c95 2020-08-27T06:17:23.093 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-08-27T11:20:30.622 INFO:teuthology.results:Tests finished! gathering results... 2020-08-27T11:20:42.724 INFO:scrape:Found 24 jobs 2020-08-27T11:20:50.459 INFO:scrape:Found 4 distinct failure reasons 2020-08-27T11:20:50.463 INFO:scrape:Failure: Command failed on smithi078 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel' 2020-08-27T11:20:50.464 INFO:scrape:1 jobs: ['5376622'] 2020-08-27T11:20:50.464 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/testing/{flavor/centos_latest', 'q_check_counter/check_counter', 'tasks/cfuse_workunit_misc}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-08-27T11:20:50.465 INFO:scrape: 2020-08-27T11:20:50.465 INFO:scrape:Failure: 2020-08-27T11:20:50.466 INFO:scrape:1 jobs: ['5376645'] 2020-08-27T11:20:50.466 INFO:scrape:suites: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}'] 2020-08-27T11:20:50.467 INFO:scrape: 2020-08-27T11:20:50.467 INFO:scrape:Failure: 500 Server Error: Internal Server Error for url: https://1.chacra.ceph.com/repos/ceph/master/fb44c2f5009f8e2e18663251149c3bf6b06256a9/centos/8/flavors/notcmalloc/repo 2020-08-27T11:20:50.468 INFO:scrape:2 jobs: ['5376629', '5376637'] 2020-08-27T11:20:50.468 INFO:scrape:suites intersection: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'multimds/verify/{begin', 'osd}', 'overrides/{fuse-default-perm-no', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}'] 2020-08-27T11:20:50.469 INFO:scrape:suites union: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/fuse', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_dbench', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}'] 2020-08-27T11:20:50.469 INFO:scrape: 2020-08-27T11:20:50.470 INFO:scrape:Failure: "2020-08-27T06:44:11.002215+0000 mon.a (mon.0) 76 : cluster [WRN] Replacing daemon mds.d as rank 0 with standby daemon mds.a" in cluster log 2020-08-27T11:20:50.470 INFO:scrape:1 jobs: ['5376636'] 2020-08-27T11:20:50.470 INFO:scrape:suites: ['begin', 'ceph-thrash/mon', 'clusters/3-mds-2-standby', 'conf/{client', 'k-testing}', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'msgr-failures/osd-mds-delay', 'multimds/thrash/{0-supported-random-distro$/{rhel_8}', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_pjd}', 'thrash/{frag_enable', 'thrash_debug}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-08-27T11:20:50.471 INFO:scrape: 2020-08-27T11:20:50.473 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 19 Fail ================================================================= [5376622] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} ----------------------------------------------------------------- time: 00:03:22 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376622/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376622/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=1f4d455b597a4609908e2612144614e7 Command failed on smithi078 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl- devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr- devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio- devel libtool libuuid-devel xfsprogs-devel' [5376629] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376629/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376629/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=524d347b6d1647f6bfcff842c43f389d 500 Server Error: Internal Server Error for url: https://1.chacra.ceph.com/ repos/ceph/master/fb44c2f5009f8e2e18663251149c3bf6b06256a9/centos/8/flavors /notcmalloc/repo [5376636] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} ----------------------------------------------------------------- time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376636/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376636/ "2020-08-27T06:44:11.002215+0000 mon.a (mon.0) 76 : cluster [WRN] Replacing daemon mds.d as rank 0 with standby daemon mds.a" in cluster log [5376637] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 00:02:18 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376637/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376637/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=6e66301f87274a53ab04094e128527d0 500 Server Error: Internal Server Error for url: https://1.chacra.ceph.com/ repos/ceph/master/fb44c2f5009f8e2e18663251149c3bf6b06256a9/centos/8/flavors /notcmalloc/repo [5376645] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} ----------------------------------------------------------------- time: 04:47:17 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376645/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376645/ sentry: https://sentry.ceph.com/sepia/teuthology/?q=1501aa5eec97454fb9eb4e5c372f998c Pass ================================================================= [5376623] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} time: 00:27:55 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376623/ [5376624] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:32:17 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376624/ [5376625] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} time: 00:28:30 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376625/ [5376626] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} time: 00:32:11 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376626/ [5376627] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench} time: 01:41:13 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376627/ [5376628] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:28:18 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376628/ [5376630] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb} time: 00:39:39 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376630/ [5376631] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} time: 00:26:46 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376631/ [5376632] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:24:20 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376632/ [5376633] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} time: 01:39:20 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376633/ [5376634] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} time: 01:23:55 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376634/ [5376635] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376635/ [5376638] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} time: 00:41:07 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376638/ [5376639] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376639/ [5376640] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376640/ [5376641] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} time: 01:29:34 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376641/ [5376642] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} time: 03:11:26 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376642/ [5376643] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} time: 02:01:18 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376643/ [5376644] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:35:26 info: http://pulpito.ceph.com/teuthology-2020-08-26_04:15:02-multimds-master-distro-basic-smithi/5376644/