2020-06-13T19:41:38.803 INFO:root:teuthology version: 1.0.0-6c966fe
2020-06-13T19:41:38.805 INFO:teuthology.results:subset: '22/2999'
2020-06-13T19:41:38.805 INFO:teuthology.results:seed: '5467'
2020-06-13T20:15:34.506 INFO:root:teuthology version: 1.0.0-6c966fe
2020-06-13T20:15:34.545 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-06-13T22:13:36.914 INFO:teuthology.results:Tests finished! gathering results...
2020-06-13T22:13:36.984 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[5129213]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
-----------------------------------------------------------------
time:   01:25:38
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129213/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129213/

    "2020-06-13 21:05:28.782165 mon.b (mon.0) 181 : cluster [WRN] Health check
    failed: Degraded data redundancy: 14456/420742 objects degraded (3.436%), 3
    pgs degraded (PG_DEGRADED)" in cluster log

[5129223]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   01:35:32
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129223/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129223/

    "2020-06-13 20:56:09.454925 mon.b (mon.0) 271 : cluster [WRN] Health check
    failed: 1 MDSs report slow metadata IOs (MDS_SLOW_METADATA_IO)" in cluster
    log



Pass
=================================================================
[5129203] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:18:32
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129203/

[5129205] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:43
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129205/

[5129207] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:13:01
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129207/

[5129209] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:18:15
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129209/

[5129211] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:30:15
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129211/

[5129212] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:53:10
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129212/

[5129214] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:28:34
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129214/

[5129215] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:39:06
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129215/

[5129216] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:30:06
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129216/

[5129217] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{centos_latest}} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:23:17
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129217/

[5129218] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:19:56
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129218/

[5129219] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:35:11
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129219/

[5129220] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:53:32
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129220/

[5129221] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:01:27
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129221/

[5129222] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:21:06
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129222/

[5129224] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:25:20
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129224/

[5129225] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:22:08
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129225/

[5129226] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:20:48
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129226/

[5129227] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   01:00:30
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129227/

[5129228] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{kernel-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   00:52:37
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129228/

[5129229] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{rhel_latest}} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:18:33
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129229/

[5129230] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/random/{k-testing supported$/{ubuntu_latest}} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:13
info:   http://pulpito.ceph.com/teuthology-2020-06-08_13:15:03-multimds-nautilus-testing-basic-smithi/5129230/