2020-10-25T00:26:46.671 INFO:root:teuthology version: 1.0.0-f4fe713
2020-10-25T00:26:46.673 INFO:teuthology.results:subset: '20/9999'
2020-10-25T00:26:46.673 INFO:teuthology.results:seed: '1973'
2020-10-25T00:40:51.432 INFO:root:teuthology version: 1.0.0-f4fe713
2020-10-25T00:40:51.489 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-10-25T03:21:54.507 INFO:teuthology.results:Tests finished! gathering results...
2020-10-25T03:21:57.054 INFO:scrape:Found 24 jobs
2020-10-25T03:21:57.592 INFO:scrape:Found 1 distinct failure reasons
2020-10-25T03:21:57.593 INFO:scrape:Failure: "2020-10-25T01:39:01.184254+0000 mds.b (mds.2) 1 : cluster [WRN] client.4590 isn't responding to mclientcaps(revoke), ino 0x3000000278e pending pAsLsXsFsx issued pAsLsXsxFsx, sent 62.792108 seconds ago" in cluster log
2020-10-25T03:21:57.593 INFO:scrape:2 jobs: ['5535338', '5535321']
2020-10-25T03:21:57.594 INFO:scrape:suites intersection: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-10-25T03:21:57.594 INFO:scrape:suites union: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-10-25T03:21:57.594 INFO:scrape:
2020-10-25T03:21:57.596 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[5535321]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:08:25
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535321/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535321/

    "2020-10-25T02:05:35.793165+0000 mds.b (mds.0) 1 : cluster [WRN]
    client.4536 isn't responding to mclientcaps(revoke), ino 0x30000002b1c
    pending pAsLsXs issued pAsLsXsFsx, sent 63.934028 seconds ago" in cluster
    log

[5535338]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:30:18
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535338/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535338/

    "2020-10-25T01:39:01.184254+0000 mds.b (mds.2) 1 : cluster [WRN]
    client.4590 isn't responding to mclientcaps(revoke), ino 0x3000000278e
    pending pAsLsXsFsx issued pAsLsXsxFsx, sent 62.792108 seconds ago" in
    cluster log



Pass
=================================================================
[5535295] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   02:13:31
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535295/

[5535297] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:04:56
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535297/

[5535299] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:17:49
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535299/

[5535301] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:20:15
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535301/

[5535303] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:24:57
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535303/

[5535305] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
time:   02:33:38
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535305/

[5535307] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:15:39
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535307/

[5535309] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:15:19
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535309/

[5535311] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:41:58
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535311/

[5535313] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:03:43
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535313/

[5535315] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:24:55
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535315/

[5535317] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:22:14
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535317/

[5535319] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   02:00:25
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535319/

[5535323] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:44:46
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535323/

[5535325] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:48
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535325/

[5535327] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:48
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535327/

[5535329] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:09:07
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535329/

[5535331] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:33:20
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535331/

[5535333] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:25
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535333/

[5535336] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:07:52
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535336/

[5535340] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:31:44
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535340/

[5535342] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:11
info:   http://pulpito.ceph.com/teuthology-2020-10-18_13:15:03-multimds-octopus-distro-basic-smithi/5535342/