Found 232 jobs Misunderstood line: Binary file /home/teuthworker/archive/pdonnell-2020-10-09_05:07:33-fs-wip-pdonnell-testing-20201009.020122-distro-basic-smithi/5508631/teuthology.log matches Misunderstood line: Found 4 distinct failure reasons Failure: Test failure: test_up_less_than_max (tasks.cephfs.test_failover.TestClusterResize) 5 jobs: ['5508695', '5508742', '5508603', '5508787', '5508650'] suites intersection: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'osd}', 'overrides/{frag_enable', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['clusters/1a3s-mds-2c-client', 'conf/{client', 'fs/multifs/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'objectstore-ec/bluestore-comp', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'objectstore-ec/filestore-xfs', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{centos_8}', 'supported-random-distros$/{rhel_8}', 'supported-random-distros$/{ubuntu_latest}', 'tasks/failover}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: reached maximum tries (50) after waiting for 300 seconds 2 jobs: ['5508723', '5508604'] suites: ['centos_latest', 'clusters/fixed-2-ucephfs', 'conf/{client', 'fs/verify/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{frag_enable', 'tasks/cfuse_workunit_suites_dbench', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: "2020-10-09T21:08:23.602886+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4647.0:47224 4.7s0 4:eff9002a:::100000001f8.00000003:head [write 1839104~4096 in=4096b,write 2080768~4096 in=4096b,write 2138112~4096 in=4096b,write 2146304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected e25) initiated 2020-10-09T21:05:23.559334+0000 currently started" in cluster log 1 jobs: ['5508724'] suites: ['clusters/fixed-2-ucephfs', 'conf/{client', 'fs/basic_workload/{begin', 'inline/no', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'omap_limit/10', 'osd}', 'overrides/{frag_enable', 'supported-random-distros$/{rhel_8}', 'tasks/cfuse_workunit_suites_fsync}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Valgrind: 1 jobs: ['5508631'] suites: ['centos_latest', 'clusters/fixed-2-ucephfs', 'conf/{client', 'fs/verify/{begin', 'mds', 'mon', 'mon-debug', 'mount/fuse', 'objectstore-ec/bluestore-comp-ec-root', 'osd}', 'overrides/{frag_enable', 'tasks/cfuse_workunit_suites_dbench', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}']