2020-06-27T11:53:02.991 INFO:root:teuthology version: 1.0.0-22bcea5
2020-06-27T11:53:02.993 INFO:teuthology.results:subset: '11/9999'
2020-06-27T11:53:02.993 INFO:teuthology.results:seed: '8765'
2020-06-27T12:01:05.963 INFO:root:teuthology version: 1.0.0-22bcea5
2020-06-27T12:01:05.995 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-06-27T15:34:09.881 INFO:teuthology.results:Tests finished! gathering results...
2020-06-27T15:34:11.669 INFO:scrape:Found 24 jobs
2020-06-27T15:34:13.107 INFO:scrape:Found 2 distinct failure reasons
2020-06-27T15:34:13.109 INFO:scrape:Failure: 
2020-06-27T15:34:13.110 INFO:scrape:2 jobs: ['5181935', '5181927']
2020-06-27T15:34:13.110 INFO:scrape:suites intersection: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-06-27T15:34:13.111 INFO:scrape:suites union: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_fsstress', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-06-27T15:34:13.111 INFO:scrape:
2020-06-27T15:34:13.112 INFO:scrape:Failure: reached maximum tries (50) after waiting for 300 seconds
2020-06-27T15:34:13.112 INFO:scrape:1 jobs: ['5181942']
2020-06-27T15:34:13.112 INFO:scrape:suites: ['centos_latest', 'clusters/3-mds', 'conf/{client', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'multimds/verify/{begin', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{fuse-default-perm-no', 'tasks/cfuse_workunit_suites_dbench', 'validater/valgrind}', 'verify/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}}']
2020-06-27T15:34:13.113 INFO:scrape:
2020-06-27T15:34:13.115 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/
failed:  3
dead:    0
running: 0
waiting: 0
queued:  0
passed:  21


Fail
=================================================================
[5181927]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   03:26:47
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181927/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181927/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=d4cefdd0c7194337b4254c80c71babf6

[5181935]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind}
-----------------------------------------------------------------
time:   02:52:52
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181935/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181935/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=51645dc37677488f85f9662f4e9d6fc0

[5181942]  multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind}
-----------------------------------------------------------------
time:   01:04:51
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181942/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181942/

    reached maximum tries (50) after waiting for 300 seconds



Pass
=================================================================
[5181926] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:35:28
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181926/

[5181928] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:16:21
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181928/

[5181929] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports}
time:   00:20:15
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181929/

[5181930] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots}
time:   00:28:18
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181930/

[5181931] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep}
time:   01:07:21
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181931/

[5181932] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:18:22
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181932/

[5181933] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build}
time:   00:55:01
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181933/

[5181934] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc}
time:   00:50:27
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181934/

[5181936] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:19:01
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181936/

[5181937] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats}
time:   00:22:10
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181937/

[5181938] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench}
time:   00:45:15
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181938/

[5181939] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:20:05
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181939/

[5181940] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:20:30
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181940/

[5181941] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench}
time:   01:04:34
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181941/

[5181943] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb}
time:   00:36:09
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181943/

[5181944] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd}
time:   00:17:27
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181944/

[5181945] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress}
time:   00:20:17
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181945/

[5181946] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep}
time:   00:20:13
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181946/

[5181947] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx}
time:   00:44:48
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181947/

[5181948] multimds/thrash/{0-supported-random-distro$/{rhel_latest} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress}
time:   00:19:35
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181948/

[5181949] multimds/basic/{0-supported-random-distro$/{rhel_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd}
time:   00:15:59
info:   http://pulpito.ceph.com/teuthology-2020-06-26_13:15:03-multimds-octopus-testing-basic-smithi/5181949/