Found 8 jobs Missing log /home/teuthworker/archive/jlayton-2022-04-28_16:55:15-fs:thrash-wip-vshankar-testing1-20220427-145314-wip-55258-default-smithi/6811327/remote/smithi067/log/ceph-mgr.x.log.gz Not-understood crash indication Missing log /home/teuthworker/archive/jlayton-2022-04-28_16:55:15-fs:thrash-wip-vshankar-testing1-20220427-145314-wip-55258-default-smithi/6811327/remote/smithi067/log/ceph-mgr.x.log.gz Not-understood crash indication Missing log /home/teuthworker/archive/jlayton-2022-04-28_16:55:15-fs:thrash-wip-vshankar-testing1-20220427-145314-wip-55258-default-smithi/6811327/remote/smithi067/log/ceph-mgr.x.log.gz Not-understood crash indication Missing log /home/teuthworker/archive/jlayton-2022-04-28_16:55:15-fs:thrash-wip-vshankar-testing1-20220427-145314-wip-55258-default-smithi/6811327/remote/smithi067/log/ceph-mgr.x.log.gz Not-understood crash indication Missing log /home/teuthworker/archive/jlayton-2022-04-28_16:55:15-fs:thrash-wip-vshankar-testing1-20220427-145314-wip-55258-default-smithi/6811327/remote/smithi067/log/ceph-mgr.x.log.gz Not-understood crash indication Found 4 distinct failure reasons Failure: Command failed on smithi104 with status 1: "(cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs)" 3 jobs: ['6811328', '6811332', '6811330'] suites intersection: ['1-ceph', '2-logrotate}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'fs:thrash/workloads/{begin/{0-install', 'mds', 'mon', 'msgr-failures/none', 'osd}', 'overrides/{frag', 'prefetch_entire_dirfrags/yes', 'races', 'session_timeout', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] suites union: ['1-ceph', '2-logrotate}', '2-workunit/fs/trivial_sync}}', '2-workunit/suites/ffsb}}', '2-workunit/suites/pjd}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{centos_8}', 'distro/{ubuntu_latest}', 'fs:thrash/workloads/{begin/{0-install', 'mds', 'mon', 'mount', 'mount/fuse', 'mount/kclient/{mount-syntax/{v1}', 'mount/kclient/{mount-syntax/{v2}', 'ms-die-on-skipped}}', 'msgr-failures/none', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/bluestore-ec-root', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{distro/testing/k-testing', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/yes', 'races', 'ranks/1', 'ranks/3', 'ranks/5', 'rhel_8}', 'session_timeout', 'tasks/{1-thrash/mds', 'tasks/{1-thrash/mon', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: {'smithi007.front.sepia.ceph.com': {'changed': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi007.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}, 'smithi097.front.sepia.ceph.com': {'changed': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi097.front.sepia.ceph.com port 22: No route to host', 'unreachable': True}} 1 jobs: ['6811333'] suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:thrash/workloads/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-comp', 'osd}', 'overrides/{frag', 'prefetch_dirfrags/no', 'prefetch_entire_dirfrags/no', 'races', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/osd', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: 1 jobs: ['6811327'] suites: ['1-ceph', '2-logrotate}', '2-workunit/fs/snaps}}', 'clusters/1a5s-mds-1c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs:thrash/workloads/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{frag', 'prefetch_dirfrags/yes', 'prefetch_entire_dirfrags/no', 'races', 'ranks/1', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}'] Failure: '2022-04-28T17:24:25.628244+00:00 smithi064 kernel: BUG: sleeping function called from invalid context at block/blk-sysfs.c:767 ' in syslog 1 jobs: ['6811326'] suites: ['1-ceph', '2-logrotate}', '2-workunit/cfuse_workunit_trivial_sync}}', 'clusters/1a3s-mds-2c-client', 'conf/{client', 'distro/{rhel_8}', 'fs:thrash/multifs/{begin/{0-install', 'mds', 'mon', 'mount/fuse', 'msgr-failures/osd-mds-delay', 'multifs', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{frag', 'session_timeout', 'tasks/{1-thrash/mds', 'thrashosds-health', 'whitelist_health', 'whitelist_wrongly_marked_down}']