2020-12-25T18:21:56.628 INFO:root:teuthology version: 1.0.0-8e49dda4
2020-12-25T18:21:56.629 INFO:teuthology.results:subset: '18/9999'
2020-12-25T18:21:56.629 INFO:teuthology.results:seed: '8519'
2020-12-25T18:49:05.002 INFO:root:teuthology version: 1.0.0-8e49dda4
2020-12-25T18:49:05.053 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-12-25T21:14:08.071 INFO:teuthology.results:Tests finished! gathering results...
2020-12-25T21:14:10.717 INFO:scrape:Found 24 jobs
2020-12-25T21:14:11.353 INFO:scrape:Found 2 distinct failure reasons
2020-12-25T21:14:11.353 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds
2020-12-25T21:14:11.354 INFO:scrape:1 jobs: ['5718614']
2020-12-25T21:14:11.354 INFO:scrape:suites: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{fuse-default-perm-no', 'session_timeout', 'tasks/cfuse_workunit_suites_dbench', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-12-25T21:14:11.355 INFO:scrape:
2020-12-25T21:14:11.355 INFO:scrape:Failure: "2020-12-25T19:13:52.691705+0000 mds.c (mds.1) 1 : cluster [WRN] evicting unresponsive client smithi014:0 (4520), after 304.296 seconds" in cluster log
2020-12-25T21:14:11.356 INFO:scrape:1 jobs: ['5718604']
2020-12-25T21:14:11.356 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/no', 'mds', 'mon', 'mount/fuse', 'multimds/basic/{0-supported-random-distro$/{ubuntu_latest}', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'q_check_counter/check_counter', 'session_timeout', 'tasks/cfuse_workunit_suites_ffsb}', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2020-12-25T21:14:11.357 INFO:scrape:
2020-12-25T21:14:11.358 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[5718604]  multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
-----------------------------------------------------------------
time:   01:21:25
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718604/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718604/

    "2020-12-25T19:13:52.691705+0000 mds.c (mds.1) 1 : cluster [WRN] evicting
    unresponsive client smithi014:0 (4520), after 304.296 seconds" in cluster
    log

[5718614]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
-----------------------------------------------------------------
time:   01:08:34
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718614/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718614/

    reached maximum tries (50) after waiting for 300 seconds



Pass
=================================================================
[5718600] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:36:09
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718600/

[5718601] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:59:46
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718601/

[5718602] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:34
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718602/

[5718603] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:09
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718603/

[5718605] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:24:57
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718605/

[5718606] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   01:01:29
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718606/

[5718607] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:27:17
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718607/

[5718608] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:39:46
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718608/

[5718609] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:46:55
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718609/

[5718610] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:58
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718610/

[5718611] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:19:28
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718611/

[5718612] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:38:03
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718612/

[5718613] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:25:09
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718613/

[5718615] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:26:46
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718615/

[5718616] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:02:38
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718616/

[5718617] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:19:00
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718617/

[5718618] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:21:43
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718618/

[5718619] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:16
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718619/

[5718620] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:18:50
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718620/

[5718621] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:42:22
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718621/

[5718622] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   01:00:03
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718622/

[5718623] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:28:02
info:   http://pulpito.ceph.com/teuthology-2020-12-18_13:15:03-multimds-octopus-distro-basic-smithi/5718623/