2021-06-18T17:37:43.789 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-18T17:37:43.791 INFO:teuthology.results:subset: '21/100000' 2021-06-18T17:37:43.791 INFO:teuthology.results:seed: '1195' 2021-06-18T17:59:19.660 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-18T17:59:19.694 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-06-18T20:09:28.955 INFO:teuthology.results:Tests finished! gathering results... 2021-06-18T20:09:30.738 INFO:scrape:Found 24 jobs 2021-06-18T20:09:31.132 INFO:scrape:Found 1 distinct failure reasons 2021-06-18T20:09:31.133 INFO:scrape:Failure: The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'} 2021-06-18T20:09:31.133 INFO:scrape:1 jobs: ['6179456'] 2021-06-18T20:09:31.134 INFO:scrape:suites: ['begin', 'clusters/3-mds', 'conf/{client', 'fuse-default-perm-no}', 'inline/yes', 'mds', 'mon', 'mount/kclient/{mount', 'ms-die-on-skipped}}', 'multimds/basic/{0-supported-random-distro$/{rhel_7}', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{basic/{frag_enable', 'overrides/{distro/rhel/{k-distro', 'q_check_counter/check_counter', 'rhel_latest}', 'session_timeout', 'tasks/cephfs_test_exports}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-06-18T20:09:31.134 INFO:scrape: 2021-06-18T20:09:31.136 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 23 Fail ================================================================= [6179456] multimds/basic/{0-supported-random-distro$/{rhel_7} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} ----------------------------------------------------------------- time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179456/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179456/ The following counters failed to be set on mds daemons: {'mds.exported', 'mds.imported'} Pass ================================================================= [6179451] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} time: 01:01:40 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179451/ [6179452] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} time: 00:34:39 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179452/ [6179453] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} time: 00:10:58 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179453/ [6179454] multimds/thrash/{0-supported-random-distro$/{ubuntu_16.04} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:13:31 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179454/ [6179455] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} time: 02:23:25 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179455/ [6179457] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:35:08 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179457/ [6179458] multimds/thrash/{0-supported-random-distro$/{rhel_7} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179458/ [6179459] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} time: 01:01:32 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179459/ [6179460] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} time: 00:37:39 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179460/ [6179461] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} time: 01:17:26 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179461/ [6179462] multimds/thrash/{0-supported-random-distro$/{centos_latest} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179462/ [6179463] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/valgrind} time: 02:07:21 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179463/ [6179464] multimds/basic/{0-supported-random-distro$/{rhel_7} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179464/ [6179465] multimds/basic/{0-supported-random-distro$/{rhel_7} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} time: 00:24:57 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179465/ [6179466] multimds/thrash/{0-supported-random-distro$/{rhel_7} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:25:35 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179466/ [6179467] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179467/ [6179468] multimds/basic/{0-supported-random-distro$/{rhel_7} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench} time: 00:55:16 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179468/ [6179469] multimds/basic/{0-supported-random-distro$/{rhel_7} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb} time: 00:38:55 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179469/ [6179470] multimds/thrash/{0-supported-random-distro$/{rhel_7} begin ceph-thrash/default clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:12:37 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179470/ [6179471] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} time: 00:51:10 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179471/ [6179472] multimds/basic/{0-supported-random-distro$/{centos_latest} begin clusters/3-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/rhel/{k-distro rhel_latest} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} time: 00:18:58 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179472/ [6179473] multimds/basic/{0-supported-random-distro$/{ubuntu_16.04} begin clusters/9-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179473/ [6179474] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/default clusters/9-mds-3-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable session_timeout whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:24:29 info: http://pulpito.ceph.com/yuriw-2021-06-18_15:29:20-multimds-nautilus-distro-basic-smithi/6179474/