Found 14 jobs Found 4 distinct failure reasons Failure: Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) 1 jobs: ['7406462'] suites: ['agent/off', 'mon_election/classic', 'orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0', 'task/test_nfs}'] Failure: 5 jobs: ['7406468', '7406475', '7406474', '7406471', '7406463'] suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}'] suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4'] Failure: '2023-09-29T22:49:39.085033+00:00 smithi060 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog 1 jobs: ['7406464'] suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] Failure: Command failed on smithi167 with status 123: "sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 1 jobs: ['7406472'] suites: ['fixed-2', 'mode/root', 'mon_election/classic', 'msgr/async', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'start', 'tasks/rados_python}']