Found 101 jobs Found 5 distinct failure reasons Failure: timeout expired in wait_until_healthy 1 jobs: ['7551809'] suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/v16.2.4'] Failure: Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) 1 jobs: ['7551741'] suites: ['orch:cephadm/nfs/{cluster/{1-node}', 'overrides/ignorelist_health', 'supported-random-distros$/{ubuntu_latest}', 'tasks/nfs}'] Failure: '2024-02-08T18:58:00.683233+00:00 smithi099 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog 1 jobs: ['7551774'] suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] Failure: Command failed on smithi067 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.67:/fake /mnt/foo'" 1 jobs: ['7551761'] suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] Failure: Command failed on smithi028 with status 5: 'sudo systemctl stop ceph-e0a7177a-c6b6-11ee-95b6-87774f69a715@mon.smithi028' 1 jobs: ['7551824'] suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific']