Found 304 jobs
Misunderstood line: 
Misunderstood line: 
Misunderstood line: 
Found 5 distinct failure reasons
Failure: "2024-03-23T01:07:04.631774+0000 mon.a (mon.0) 649 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
3 jobs: ['7617015', '7616877', '7616610']
suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'validater/valgrind}']
suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'validater/valgrind}']

Valgrind: mon (Leak_StillReachable)
3 jobs: ['7616742', '7616740', '7616574']
suites intersection: []
suites union: ['2-inject-leak/mon', '2-inject-leak/none', 'centos_latest}', 'ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'tasks/mon_recovery', 'validater/valgrind}']

Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi159 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=82316b04821a6c2c1d458a881920454bbadb8837 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
3 jobs: ['7616800', '7617064', '7616576']
suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_cephadm}']
suites union: ['agent/on', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_cephadm}']

Failure: Command failed on smithi173 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/kvtest && cd $TESTDIR/kvtest && ceph_test_keyvaluedb'"
2 jobs: ['7616712', '7616706']
suites intersection: []
suites union: ['mon_election/classic', 'rados', 'rados/objectstore/{backends/keyvaluedb', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{ubuntu_latest}}']

Failure: timeout expired in wait_until_healthy
1 jobs: ['7616628']
suites: ['0-nvme-loop', '1-start', '2-ops/rmdir-reactivate}', 'rados/cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0']