2021-05-27T05:27:52.903 INFO:root:teuthology version: 1.1.0-0c70841a 2021-05-27T05:27:52.904 INFO:teuthology.results:seed: '3550' 2021-05-27T05:31:49.933 INFO:root:teuthology version: 1.1.0-0c70841a 2021-05-27T05:31:49.939 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-27T17:32:35.257 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2021-05-27T17:32:35.517 INFO:scrape:Found 2 jobs 2021-05-27T17:32:36.710 INFO:scrape:Found 2 distinct failure reasons 2021-05-27T17:32:36.711 INFO:scrape:Failure: "2021-05-27T05:50:23.213716+0000 mon.a (mon.0) 634 : cluster [ERR] Health check failed: Full OSDs blocking recovery: 3 pgs recovery_toofull (PG_RECOVERY_FULL)" in cluster log 2021-05-27T17:32:36.711 INFO:scrape:1 jobs: ['6137597'] 2021-05-27T17:32:36.712 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{rhel_8.yaml}', 'fs:functional:/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/fuse.yaml', 'no_client_pidfile.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{frag_enable.yaml', 'tasks/mds-full.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2021-05-27T17:32:36.712 INFO:scrape: 2021-05-27T17:32:36.712 INFO:scrape:Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2021-05-27T17:32:36.713 INFO:scrape:1 jobs: ['6137596'] 2021-05-27T17:32:36.713 INFO:scrape:suites: ['clusters/1a3s-mds-4c-client.yaml', 'conf/{client.yaml', 'distro/{ubuntu_latest.yaml}', 'fs:functional:/{begin.yaml', 'mds.yaml', 'mon.yaml', 'mount/kclient/{mount.yaml', 'ms-die-on-skipped.yaml}}', 'no_client_pidfile.yaml', 'objectstore/bluestore-ec-root.yaml', 'osd.yaml}', 'overrides/{distro/stock/{k-stock.yaml', 'overrides/{frag_enable.yaml', 'rhel_8.yaml}', 'tasks/mds-full.yaml}', 'whitelist_health.yaml', 'whitelist_wrongly_marked_down.yaml}'] 2021-05-27T17:32:36.714 INFO:scrape: