2020-05-28T22:14:01.138 INFO:root:teuthology version: 1.0.0-5ae3303 2020-05-28T22:14:01.140 INFO:teuthology.results:subset: '9/9999' 2020-05-28T22:14:01.140 INFO:teuthology.results:seed: '7346' 2020-05-28T22:29:55.657 INFO:root:teuthology version: 1.0.0-23f2864 2020-05-28T22:29:55.680 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-29T01:32:59.415 INFO:teuthology.results:Tests finished! gathering results... 2020-05-29T01:32:59.484 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 22 Fail ================================================================= [5094149] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} ----------------------------------------------------------------- time: 01:05:04 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094149/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094149/ reached maximum tries (50) after waiting for 300 seconds [5094154] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_exports} ----------------------------------------------------------------- time: 00:18:18 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094154/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094154/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e8fb2266e7d24deb834ad2714c383ffa Test failure: test_export_pin_getfattr (tasks.cephfs.test_exports.TestExports) Pass ================================================================= [5094147] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} time: 00:21:21 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094147/ [5094148] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:23:56 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094148/ [5094150] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsx} time: 00:52:19 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094150/ [5094151] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_pjd} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094151/ [5094152] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} time: 00:26:02 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094152/ [5094153] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094153/ [5094155] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cephfs_test_snapshots} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094155/ [5094156] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} time: 01:02:49 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094156/ [5094157] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094157/ [5094158] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_kernel_untar_build} time: 02:45:19 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094158/ [5094159] multimds/basic/{0-supported-random-distro$/{ubuntu_latest} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_misc} time: 00:58:44 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094159/ [5094160] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_fsstress validater/lockdep} time: 00:24:50 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094160/ [5094161] multimds/thrash/{0-supported-random-distro$/{centos_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094161/ [5094162] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/filestore-xfs overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_norstats} time: 00:18:32 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094162/ [5094163] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_blogbench} time: 00:35:36 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094163/ [5094164] multimds/verify/{begin centos_latest clusters/3-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/valgrind} time: 01:02:10 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094164/ [5094165] multimds/thrash/{0-supported-random-distro$/{ubuntu_latest} begin ceph-thrash/mds clusters/3-mds-2-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_fsstress} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094165/ [5094166] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_dbench} time: 01:06:09 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094166/ [5094167] multimds/basic/{0-supported-random-distro$/{rhel_8} begin clusters/9-mds conf/{client mds mon osd} inline/yes mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_ffsb} time: 00:37:57 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094167/ [5094168] multimds/verify/{begin centos_latest clusters/9-mds conf/{client mds mon osd} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{fuse-default-perm-no verify/{frag_enable mon-debug whitelist_health whitelist_wrongly_marked_down}} tasks/cfuse_workunit_suites_dbench validater/lockdep} time: 00:58:51 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094168/ [5094169] multimds/thrash/{0-supported-random-distro$/{rhel_8} begin ceph-thrash/mon clusters/9-mds-3-standby conf/{client mds mon osd} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} msgr-failures/none objectstore-ec/filestore-xfs overrides/{fuse-default-perm-no thrash/{frag_enable whitelist_health whitelist_wrongly_marked_down} thrash_debug} tasks/cfuse_workunit_suites_pjd} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094169/ [5094170] multimds/basic/{0-supported-random-distro$/{centos_8} begin clusters/3-mds conf/{client mds mon osd} inline/no mount/kclient/{mount overrides/{distro/testing/{flavor/centos_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{basic/{frag_enable whitelist_health whitelist_wrongly_marked_down} fuse-default-perm-no} q_check_counter/check_counter tasks/cfuse_workunit_suites_fsstress} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2020-05-27_04:15:02-multimds-master-testing-basic-smithi/5094170/