2020-06-07T17:54:18.444 INFO:root:teuthology version: 1.0.0-61def67
2020-06-07T17:54:18.446 INFO:teuthology.results:subset: '27/2999'
2020-06-07T17:54:18.446 INFO:teuthology.results:seed: '3340'
2020-06-07T19:04:29.047 INFO:root:teuthology version: 1.0.0-61def67
2020-06-07T19:04:29.083 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-06-07T22:22:33.221 INFO:teuthology.results:Tests finished! gathering results...
2020-06-07T22:22:33.289 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[5125219]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:23:26
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125219/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125219/

    "2020-06-07 20:31:11.929313 mon.a (mon.0) 605 : cluster [WRN] Health check
    failed: 1 clients failing to respond to capability release
    (MDS_CLIENT_LATE_RELEASE)" in cluster log

[5125234]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:38:51
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125234/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125234/

    reached maximum tries (50) after waiting for 300 seconds



Pass
=================================================================
[5125214] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{ubuntu_16.04}} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:35
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125214/

[5125216] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:21:10
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125216/

[5125218] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:23:16
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125218/

[5125220] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:17
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125220/

[5125221] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:21:41
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125221/

[5125222] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   02:07:19
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125222/

[5125223] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:09:12
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125223/

[5125224] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:30:10
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125224/

[5125225] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:25
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125225/

[5125226] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{ubuntu_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:35:53
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125226/

[5125227] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:31:44
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125227/

[5125228] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{ubuntu_16.04}} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:31
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125228/

[5125229] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:17:59
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125229/

[5125230] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:16:45
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125230/

[5125231] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:04:22
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125231/

[5125232] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:25:09
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125232/

[5125233] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{centos_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:29:19
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125233/

[5125235] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:45:21
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125235/

[5125236] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:12
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125236/

[5125237] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:03:59
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125237/

[5125238] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:09
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125238/

[5125239] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:19:39
info:   http://pulpito.ceph.com/teuthology-2020-06-07_13:15:03-multimds-nautilus-testing-basic-smithi/5125239/