Found 180 jobs
Found 5 distinct failure reasons
Failure: Command failed (workunit test rbd/cli_generic.sh) on smithi150 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=84698e743199450ee5f6969d22ebe6bed3a68e4a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh'
2 jobs: ['7424815', '7424986']
suites intersection: ['clusters/{fixed-1', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'workloads/rbd_cli_generic}']
suites union: ['clusters/{fixed-1', 'features/format-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_generic}']

Failure: "2023-10-14T03:06:18.691000+0000 osd.0 (osd.0) 10 : cluster [ERR] osd.0 found snap mapper error on pg 2.1 oid 2:8ac5c5e1:::rbd_data.1284b1fa3a05.000000000000006d:1c snaps missing in mapper, should be: 18,19,1a,1b,1c was  r -2...repaired" in cluster log
1 jobs: ['7424819']
suites: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}']

Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh
1 jobs: ['7424919']
suites: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{centos_8}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}']

Failure: Command failed on smithi158 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'
1 jobs: ['7424971']
suites: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install']

Crash: "2023-10-14T06:49:55.901046+0000 mon.a (mon.0) 1604 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
ceph version 16.2.14-75-g84698e74 (84698e743199450ee5f6969d22ebe6bed3a68e4a) pacific (stable)
 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe0) [0x5578c860a0c7]
 2: (KernelDevice::_aio_thread()+0x111f) [0x5578c925a58f]
 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5578c92656c1]
 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f17547bf609]
1 jobs: ['7424991']
suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}']