2022-06-01T23:55:36.850 INFO:root:teuthology version: 1.1.1.dev360+g53fc7fef
2022-06-01T23:55:36.850 INFO:teuthology.results:subset: '11/16'
2022-06-01T23:55:36.851 INFO:teuthology.results:seed: '1973'
2022-06-02T00:11:02.159 INFO:root:teuthology version: 1.1.1.dev360+g53fc7fef
2022-06-02T00:11:02.176 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-06-02T03:43:20.519 INFO:teuthology.results:Tests finished! gathering results...
2022-06-02T03:43:22.210 INFO:scrape:Found 20 jobs
2022-06-02T03:43:23.589 WARNING:scrape:Missing log /home/teuthworker/archive/jlayton-2022-06-01_23:54:39-fs-wip-jlayton-qa-custom-kernel-wip-fscrypt-default-smithi/6859553/remote/smithi041/log/ceph-mgr.y.log.gz
2022-06-02T03:43:23.589 WARNING:scrape:Not-understood crash indication 
2022-06-02T03:43:23.777 WARNING:scrape:Missing log /home/teuthworker/archive/jlayton-2022-06-01_23:54:39-fs-wip-jlayton-qa-custom-kernel-wip-fscrypt-default-smithi/6859553/remote/smithi041/log/ceph-mgr.y.log.gz
2022-06-02T03:43:23.777 WARNING:scrape:Not-understood crash indication 
2022-06-02T03:43:23.934 WARNING:scrape:Missing log /home/teuthworker/archive/jlayton-2022-06-01_23:54:39-fs-wip-jlayton-qa-custom-kernel-wip-fscrypt-default-smithi/6859553/remote/smithi041/log/ceph-mgr.y.log.gz
2022-06-02T03:43:23.934 WARNING:scrape:Not-understood crash indication 
2022-06-02T03:43:24.078 WARNING:scrape:Missing log /home/teuthworker/archive/jlayton-2022-06-01_23:54:39-fs-wip-jlayton-qa-custom-kernel-wip-fscrypt-default-smithi/6859553/remote/smithi041/log/ceph-mgr.y.log.gz
2022-06-02T03:43:24.079 WARNING:scrape:Not-understood crash indication 
2022-06-02T03:43:24.829 INFO:scrape:Found 3 distinct failure reasons
2022-06-02T03:43:24.830 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/suites/ffsb.sh
2022-06-02T03:43:24.830 INFO:scrape:2 jobs: ['6859554', '6859563']
2022-06-02T03:43:24.832 INFO:scrape:suites intersection: ['1-ceph', '2-logrotate}', '2-workunit/suites/ffsb}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/custom/k-custom', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'session_timeout', 'thrashosds-health}']
2022-06-02T03:43:24.832 INFO:scrape:suites union: ['1-ceph', '2-logrotate}', '2-workunit/suites/ffsb}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{rhel_8}', 'fs/thrash/workloads/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/custom/k-custom', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'thrashosds-health}']
2022-06-02T03:43:24.833 INFO:scrape:
2022-06-02T03:43:24.833 INFO:scrape:Failure: 
2022-06-02T03:43:24.833 INFO:scrape:2 jobs: ['6859562', '6859555']
2022-06-02T03:43:24.834 INFO:scrape:suites intersection: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/custom/k-custom', 'overrides/{frag', 'scrub/yes', 'session_timeout}', 'standby-replay', 'tasks/{0-check-counter', 'wsync/no}']
2022-06-02T03:43:24.834 INFO:scrape:suites union: ['1-cephadm', '2-logrotate}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{base/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'ms_mode/legacy', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{distro/custom/k-custom', 'overrides/{frag', 'ranks/3', 'ranks/5', 'scrub/yes', 'session_timeout}', 'standby-replay', 'tasks/{0-check-counter', 'workunit/fs/misc}}', 'workunit/suites/iogen}}', 'wsync/no}']
2022-06-02T03:43:24.834 INFO:scrape:
2022-06-02T03:43:24.834 INFO:scrape:Failure: Command failed on smithi041 with status 1: 'sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp'
2022-06-02T03:43:24.835 INFO:scrape:1 jobs: ['6859553']
2022-06-02T03:43:24.835 INFO:scrape:suites: ['1-ceph', '2-logrotate}', '2-workunit/cfuse_workunit_snaptests}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{centos_8}', 'fs/thrash/multifs/{begin/{0-install', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/custom/k-custom', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health}']
2022-06-02T03:43:24.835 INFO:scrape: