2020-11-12T01:52:22.754 INFO:root:teuthology version: 1.0.0-4ace5ba
2020-11-12T01:52:22.755 INFO:teuthology.results:subset: '111/120'
2020-11-12T01:52:22.756 INFO:teuthology.results:seed: '9729'
2020-11-12T02:10:56.210 INFO:root:teuthology version: 1.0.0-4ace5ba
2020-11-12T02:10:56.429 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-11-12T06:27:01.028 INFO:teuthology.results:Tests finished! gathering results...
2020-11-12T06:27:04.550 INFO:scrape:Found 28 jobs
2020-11-12T06:27:05.675 INFO:scrape:Found 1 distinct failure reasons
2020-11-12T06:27:05.676 INFO:scrape:Failure: 
2020-11-12T06:27:05.677 INFO:scrape:3 jobs: ['5614573', '5614582', '5614565']
2020-11-12T06:27:05.677 INFO:scrape:suites intersection: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-11-12T06:27:05.678 INFO:scrape:suites union: ['centos_latest', 'clusters/9-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-11-12T06:27:05.678 INFO:scrape:
2020-11-12T06:27:05.680 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/
failed:  3
dead:    0
running: 0
waiting: 0
queued:  0
passed:  25


Fail
=================================================================
[5614565]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   04:08:21
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614565/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614565/
sentry: https://sentry.ceph.com/organizations/ceph/?query=078b5b16b0b44246ab4ef92ed7f9ebb7

[5614573]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   03:41:38
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614573/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614573/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3981564300a4097a2078989a68b9c3c

[5614582]  multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   03:26:37
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614582/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614582/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ad415267896145b7a3e27bee5af266e5



Pass
=================================================================
[5614559] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:11:01
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614559/

[5614560] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:09
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614560/

[5614561] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   00:57:28
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614561/

[5614562] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:23:49
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614562/

[5614563] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:45:52
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614563/

[5614564] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:14:09
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614564/

[5614566] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:52:55
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614566/

[5614567] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:16:48
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614567/

[5614568] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:15:46
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614568/

[5614569] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:04:07
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614569/

[5614570] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:30:06
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614570/

[5614571] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   00:49:33
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614571/

[5614572] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:13:23
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614572/

[5614574] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:34:44
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614574/

[5614575] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:23:19
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614575/

[5614576] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:14:31
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614576/

[5614577] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:00:57
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614577/

[5614578] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:21:43
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614578/

[5614579] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:10:21
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614579/

[5614580] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:14:29
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614580/

[5614581] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:10:42
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614581/

[5614583] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:29:57
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614583/

[5614584] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:55:13
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614584/

[5614585] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:16:59
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614585/

[5614586] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:15:20
info:   http://pulpito.ceph.com/yuriw-2020-11-12_00:10:32-multimds-nautilus-distro-basic-smithi/5614586/