2020-10-08T20:59:37.683 INFO:root:teuthology version: 1.0.0-2cf4b81 2020-10-08T20:59:37.685 INFO:teuthology.results:subset: '3/4' 2020-10-08T20:59:37.685 INFO:teuthology.results:seed: '3765' 2020-10-08T21:35:41.949 INFO:root:teuthology version: 1.0.0-2cf4b81 2020-10-08T21:35:41.990 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-10-08T23:12:43.897 INFO:teuthology.results:Tests finished! gathering results... 2020-10-08T23:12:52.162 INFO:scrape:Found 60 jobs 2020-10-08T23:12:52.672 INFO:scrape:Found 1 distinct failure reasons 2020-10-08T23:12:52.672 INFO:scrape:Crash: Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) 2020-10-08T23:12:52.673 INFO:scrape:ceph version 16.0.0-6214-g34310776 (343107766e0336c206879ae392b6b50603029220) pacific (dev) 1: /lib64/libpthread.so.0(+0x12dc0) [0x7efc20e94dc0] 2: gsignal() 3: abort() 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7efc222a0877] 5: /usr/lib64/ceph/libceph-common.so.2(+0x275a40) [0x7efc222a0a40] 6: (MDSTableServer::handle_prepare(boost::intrusive_ptr const&)+0x471) [0x5652bfcbc951] 7: (MDSTableServer::handle_request(boost::intrusive_ptr const&)+0x75) [0x5652bfcbe8f5] 8: (MDSRank::handle_message(boost::intrusive_ptr const&)+0xad7) [0x5652bfa11ff7] 9: (MDSRank::_dispatch(boost::intrusive_ptr const&, bool)+0x7bb) [0x5652bfa1452b] 10: (MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr const&)+0x55) [0x5652bfa14b25] 11: (MDSDaemon::ms_dispatch2(boost::intrusive_ptr const&)+0x128) [0x5652bfa04dc8] 12: (DispatchQueue::entry()+0x126a) [0x7efc224caeba] 13: (DispatchQueue::DispatchThread::entry()+0x11) [0x7efc2257c1f1] 14: /lib64/libpthread.so.0(+0x82de) [0x7efc20e8a2de] 15: clone() 2020-10-08T23:12:52.673 INFO:scrape:3 jobs: ['5507188', '5507176', '5507164'] 2020-10-08T23:12:52.673 INFO:scrape:suites intersection: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mount/fuse', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'tasks/cephfs_test_snapshots}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-10-08T23:12:52.674 INFO:scrape:suites union: ['begin', 'clusters/9-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mount/fuse', 'multimds/basic/{0-supported-random-distro$/{centos_8}', 'multimds/basic/{0-supported-random-distro$/{rhel_8}', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'tasks/cephfs_test_snapshots}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2020-10-08T23:12:52.674 INFO:scrape: 2020-10-08T23:12:52.676 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 57 Fail ================================================================= [5507164] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} ----------------------------------------------------------------- time: 00:25:21 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507164/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507164/ sentry: https://sentry.ceph.com/sentry/sepia/?query=815ae2a0754d4fdebf663568d5c079d3 Test failure: test_snapclient_cache (tasks.cephfs.test_snapshots.TestSnapshots) [5507176] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} ----------------------------------------------------------------- time: 00:15:47 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507176/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507176/ sentry: https://sentry.ceph.com/sentry/sepia/?query=3b617e88af26404bad6b0d23688d5382 Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) [5507188] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} ----------------------------------------------------------------- time: 00:11:31 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507188/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507188/ sentry: https://sentry.ceph.com/sentry/sepia/?query=a9785af08f5f47ceaab74438ec419134 Test failure: test_kill_mdstable (tasks.cephfs.test_snapshots.TestSnapshots) Pass ================================================================= [5507137] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:35 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507137/ [5507138] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:48 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507138/ [5507139] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:06 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507139/ [5507140] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:25:22 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507140/ [5507141] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:25:11 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507141/ [5507142] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:24:44 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507142/ [5507143] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:17 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507143/ [5507144] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:16 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507144/ [5507145] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:26 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507145/ [5507146] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:56 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507146/ [5507147] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:32 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507147/ [5507148] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:20:02 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507148/ [5507149] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:38 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507149/ [5507150] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:02 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507150/ [5507151] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:50 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507151/ [5507152] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:25:10 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507152/ [5507153] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:25:19 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507153/ [5507154] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:24:19 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507154/ [5507155] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:20 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507155/ [5507156] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:36 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507156/ [5507157] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:03 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507157/ [5507158] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:20:27 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507158/ [5507159] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:31 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507159/ [5507160] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:07 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507160/ [5507161] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:14 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507161/ [5507162] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:47 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507162/ [5507163] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:47 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507163/ [5507165] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:27:40 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507165/ [5507166] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:26:13 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507166/ [5507167] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:06 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507167/ [5507168] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:27 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507168/ [5507169] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:34 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507169/ [5507170] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:48 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507170/ [5507171] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:50 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507171/ [5507172] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:15 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507172/ [5507173] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:51 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507173/ [5507174] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:10 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507174/ [5507175] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:55 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507175/ [5507177] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:24:07 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507177/ [5507178] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:24:29 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507178/ [5507179] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:14 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507179/ [5507180] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:16:59 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507180/ [5507181] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:16:49 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507181/ [5507182] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:12 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507182/ [5507183] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:46 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507183/ [5507184] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:06 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507184/ [5507185] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:46 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507185/ [5507186] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:24 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507186/ [5507187] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:18:23 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507187/ [5507189] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:25:32 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507189/ [5507190] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:25:03 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507190/ [5507191] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:17:17 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507191/ [5507192] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:16:52 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507192/ [5507193] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:16:56 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507193/ [5507194] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:50 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507194/ [5507195] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:36 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507195/ [5507196] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:56 info: http://pulpito.ceph.com/pdonnell-2020-10-08_20:58:25-multimds-master-distro-basic-smithi/5507196/