2020-08-26T15:44:28.590 INFO:root:teuthology version: 1.0.0-3b2e857 2020-08-26T15:44:28.591 INFO:teuthology.results:seed: '1241' 2020-08-26T15:50:23.313 INFO:root:teuthology version: 1.0.0-3b2e857 2020-08-26T15:50:23.342 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-08-26T17:17:25.394 INFO:teuthology.results:Tests finished! gathering results... 2020-08-26T17:17:26.468 INFO:scrape:Found 5 jobs 2020-08-26T17:17:31.939 INFO:scrape:Found 1 distinct failure reasons 2020-08-26T17:17:31.940 INFO:scrape:Failure: "2020-08-26T17:14:16.579815+0000 mon.a (mon.0) 88 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log 2020-08-26T17:17:31.941 INFO:scrape:5 jobs: ['5378061', '5378060', '5378058', '5378057', '5378059'] 2020-08-26T17:17:31.941 INFO:scrape:suites intersection: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'tasks/{0-install'] 2020-08-26T17:17:31.942 INFO:scrape:suites union: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/cfuse_workunit_suites_blogbench}}', 'test/cfuse_workunit_suites_fsstress}}', 'test/cfuse_workunit_suites_iozone}}', 'test/cfuse_workunit_suites_pjd}}', 'test/kclient_workunit_direct_io}}'] 2020-08-26T17:17:31.942 INFO:scrape: 2020-08-26T17:17:31.943 INFO:teuthology.results:Sending results to pdonnell@redhat.com: Test Run: pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [5378057] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/cfuse_workunit_suites_blogbench}} ----------------------------------------------------------------- time: 00:15:52 info: http://pulpito.ceph.com/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378057/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378057/ "2020-08-26T16:03:50.968403+0000 mon.a (mon.0) 110 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5378058] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/cfuse_workunit_suites_fsstress}} ----------------------------------------------------------------- time: 00:08:55 info: http://pulpito.ceph.com/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378058/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378058/ "2020-08-26T16:05:54.058728+0000 mon.b (mon.0) 109 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5378059] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_iozone}} ----------------------------------------------------------------- time: 00:12:48 info: http://pulpito.ceph.com/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378059/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378059/ "2020-08-26T16:03:19.018430+0000 mon.b (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5378060] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/cfuse_workunit_suites_pjd}} ----------------------------------------------------------------- time: 00:08:34 info: http://pulpito.ceph.com/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378060/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378060/ "2020-08-26T16:00:28.529092+0000 mon.a (mon.0) 87 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5378061] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_direct_io}} ----------------------------------------------------------------- time: 00:11:30 info: http://pulpito.ceph.com/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378061/ log: http://qa-proxy.ceph.com/teuthology/pdonnell-2020-08-26_15:43:40-smoke-master-distro-basic-smithi/5378061/ "2020-08-26T17:14:16.579815+0000 mon.a (mon.0) 88 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log