2020-09-02T16:14:43.835 INFO:root:teuthology version: 1.0.0-f1fe128 2020-09-02T16:14:43.837 INFO:teuthology.results:seed: '8377' 2020-09-02T16:34:38.670 INFO:root:teuthology version: 1.0.0-f1fe128 2020-09-02T16:34:38.746 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-09-03T04:33:58.861 INFO:teuthology.results:Tests finished! gathering results... 2020-09-03T04:34:17.247 INFO:scrape:Found 40 jobs 2020-09-03T04:36:01.329 INFO:scrape:Found 2 distinct failure reasons 2020-09-03T04:36:01.333 INFO:scrape:Failure: "2020-09-02T16:32:27.901496+0000 mon.a (mon.0) 89 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log 2020-09-03T04:36:01.333 INFO:scrape:30 jobs 2020-09-03T04:36:01.334 INFO:scrape:suites intersection: [] 2020-09-03T04:36:01.335 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'orchestrator_cli', 'rados/cephadm/orchestrator_cli/{2-node-mgr', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/rest/{mgr-restful', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/crash}', 'tasks/failover}', 'tasks/insights}', 'tasks/module_selftest}', 'tasks/prometheus}', 'tasks/workunits}'] 2020-09-03T04:36:01.335 INFO:scrape: 2020-09-03T04:36:01.335 INFO:scrape:Failure: Test failure: test_quotas_default (tasks.mgr.dashboard.test_cephfs.CephfsTest) 2020-09-03T04:36:01.336 INFO:scrape:1 jobs: ['5399913'] 2020-09-03T04:36:01.336 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-comp-zstd', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2020-09-03T04:36:01.337 INFO:scrape: 2020-09-03T04:36:01.340 INFO:teuthology.results:Sending results to to.my.trociny@gmail.com: Test Run: trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/ failed: 30 dead: 1 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [5399878] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:09:55 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399878/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399878/ "2020-09-02T16:27:38.274813+0000 mon.b (mon.0) 83 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399880] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/crash} ----------------------------------------------------------------- time: 00:12:24 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399880/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399880/ "2020-09-02T16:32:15.792828+0000 mon.a (mon.0) 116 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399881] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399881/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399881/ "2020-09-02T16:27:01.294897+0000 mon.a (mon.0) 96 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399882] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/failover} ----------------------------------------------------------------- time: 00:10:19 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399882/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399882/ "2020-09-02T16:35:08.781085+0000 mon.a (mon.0) 92 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399883] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/insights} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399883/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399883/ "2020-09-02T16:30:45.888995+0000 mon.b (mon.0) 88 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399884] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/module_selftest} ----------------------------------------------------------------- time: 00:25:00 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399884/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399884/ "2020-09-02T16:31:57.577745+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399886] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/prometheus} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399886/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399886/ "2020-09-02T16:31:35.022088+0000 mon.b (mon.0) 119 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399887] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/workunits} ----------------------------------------------------------------- time: 00:06:28 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399887/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399887/ "2020-09-02T16:32:52.902886+0000 mon.a (mon.0) 122 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399889] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:08:36 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399889/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399889/ "2020-09-02T16:34:21.464192+0000 mon.a (mon.0) 91 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399890] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/failover} ----------------------------------------------------------------- time: 00:09:27 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399890/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399890/ "2020-09-02T16:32:27.901496+0000 mon.a (mon.0) 89 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399891] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/insights} ----------------------------------------------------------------- time: 00:09:47 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399891/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399891/ "2020-09-02T16:33:05.976143+0000 mon.b (mon.0) 110 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399892] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:25:53 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399892/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399892/ "2020-09-02T16:34:44.507442+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399894] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399894/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399894/ "2020-09-02T16:34:11.001971+0000 mon.b (mon.0) 84 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399895] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:10:42 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399895/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399895/ "2020-09-02T16:43:37.259777+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399897] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399897/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399897/ "2020-09-02T16:44:37.405949+0000 mon.b (mon.0) 86 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399898] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/failover} ----------------------------------------------------------------- time: 00:14:35 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399898/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399898/ "2020-09-02T16:42:11.656253+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399899] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/insights} ----------------------------------------------------------------- time: 00:14:21 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399899/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399899/ "2020-09-02T16:41:29.544690+0000 mon.b (mon.0) 83 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399900] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/module_selftest} ----------------------------------------------------------------- time: 00:24:52 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399900/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399900/ "2020-09-02T16:37:10.574373+0000 mon.b (mon.0) 107 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399903] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/prometheus} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399903/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399903/ "2020-09-02T16:38:56.079348+0000 mon.a (mon.0) 93 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399904] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/workunits} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399904/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399904/ "2020-09-02T16:39:41.725106+0000 mon.b (mon.0) 84 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399906] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/crash} ----------------------------------------------------------------- time: 00:07:35 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399906/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399906/ "2020-09-02T16:40:15.551253+0000 mon.b (mon.0) 84 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399907] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/failover} ----------------------------------------------------------------- time: 00:14:35 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399907/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399907/ "2020-09-02T16:48:41.178921+0000 mon.a (mon.0) 91 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399908] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/insights} ----------------------------------------------------------------- time: 00:09:44 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399908/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399908/ "2020-09-02T16:44:23.986418+0000 mon.a (mon.0) 91 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399909] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:30:24 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399909/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399909/ "2020-09-02T16:49:41.917525+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399911] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/prometheus} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399911/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399911/ "2020-09-02T16:40:33.808933+0000 mon.a (mon.0) 90 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399912] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/workunits} ----------------------------------------------------------------- time: 00:05:57 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399912/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399912/ "2020-09-02T16:44:07.955090+0000 mon.b (mon.0) 87 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399914] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/crash} ----------------------------------------------------------------- time: 00:12:22 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399914/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399914/ "2020-09-02T16:47:39.504527+0000 mon.a (mon.0) 118 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399915] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} ----------------------------------------------------------------- time: 00:10:01 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399915/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399915/ "2020-09-02T16:44:09.458534+0000 mon.b (mon.0) 110 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399916] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} ----------------------------------------------------------------- time: 00:14:00 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399916/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399916/ "2020-09-02T16:49:39.169524+0000 mon.b (mon.0) 83 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log [5399917] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:25:34 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399917/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399917/ "2020-09-02T16:45:27.650208+0000 mon.b (mon.0) 83 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN)" in cluster log Dead ================================================================= [5399913] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 11:49:43 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399913/ log: http://qa-proxy.ceph.com/teuthology/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399913/ sentry: https://sentry.ceph.com/sepia/teuthology/?query=435e0d38374748298a77c152291f7d32 Test failure: test_quotas_default (tasks.mgr.dashboard.test_cephfs.CephfsTest) Pass ================================================================= [5399879] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:00 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399879/ [5399885] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:13:32 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399885/ [5399888] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:51 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399888/ [5399893] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/progress} time: 00:18:20 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399893/ [5399896] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:12 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399896/ [5399901] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/progress} time: 00:12:37 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399901/ [5399902] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:08:46 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399902/ [5399905] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:43 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399905/ [5399910] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:11:43 info: http://pulpito.ceph.com/trociny-2020-09-02_16:00:44-rados-wip-mgolub-testing-4-distro-basic-smithi/5399910/