2020-12-28T21:11:14.755 INFO:root:teuthology version: 1.0.0-8e49dda4
2020-12-28T21:11:14.756 INFO:teuthology.results:subset: '22/9999'
2020-12-28T21:11:14.756 INFO:teuthology.results:seed: '2621'
2020-12-28T21:24:57.628 INFO:root:teuthology version: 1.0.0-8e49dda4
2020-12-28T21:24:57.680 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-12-29T09:25:10.997 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2020-12-29T09:25:14.346 INFO:scrape:Found 24 jobs
2020-12-29T09:25:15.042 INFO:scrape:Found 2 distinct failure reasons
2020-12-29T09:25:15.043 INFO:scrape:Dead: b'2020-12-29T09:23:39.592 DEBUG:teuthology.exit:Finished running handlers'
2020-12-29T09:25:15.043 INFO:scrape:1 jobs: ['5727988']
2020-12-29T09:25:15.044 INFO:scrape:suites: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{fuse-default-perm-no', 'session_timeout', 'tasks/cfuse_workunit_suites_dbench', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-12-29T09:25:15.044 INFO:scrape:
2020-12-29T09:25:15.045 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds
2020-12-29T09:25:15.045 INFO:scrape:1 jobs: ['5727980']
2020-12-29T09:25:15.045 INFO:scrape:suites: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount', 'mount/kclient/{k-testing', 'ms-die-on-skipped}', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{fuse-default-perm-no', 'session_timeout', 'tasks/cfuse_workunit_suites_dbench', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-12-29T09:25:15.046 INFO:scrape:
2020-12-29T09:25:15.048 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/
failed:  1
dead:    0
running: 1
waiting: 0
queued:  0
passed:  22


Fail
=================================================================
[5727980]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
-----------------------------------------------------------------
time:   01:11:55
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727980/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727980/

    reached maximum tries (50) after waiting for 300 seconds



Running
=================================================================
[5727988] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727988/



Pass
=================================================================
[5727967] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:29:14
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727967/

[5727968] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:19:52
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727968/

[5727969] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:20:52
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727969/

[5727970] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:25:01
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727970/

[5727971] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:35:07
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727971/

[5727972] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
time:   01:09:11
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727972/

[5727973] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:24:46
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727973/

[5727974] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:21:08
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727974/

[5727975] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   01:17:22
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727975/

[5727976] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:18
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727976/

[5727977] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   01:16:18
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727977/

[5727978] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:23:09
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727978/

[5727979] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:20:33
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727979/

[5727981] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:40:23
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727981/

[5727982] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:22:16
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727982/

[5727983] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:08:40
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727983/

[5727984] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:22:36
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727984/

[5727985] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   01:52:45
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727985/

[5727986] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:26:08
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727986/

[5727987] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:21:02
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727987/

[5727989] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:42:39
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727989/

[5727990] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mon clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:20:26
info:   http://pulpito.ceph.com/teuthology-2020-12-21_13:15:03-multimds-octopus-distro-basic-smithi/5727990/