Found 23 jobs Found 4 distinct failure reasons Failure: failed to install new kernel version within timeout 1 jobs: ['7485459'] suites: ['clusters/{fixed-3', 'conf/{disable-pool-app}', 'data-pool/none', 'extra-conf/permit-partial-discard', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{centos_latest}', 'workloads/c_api_tests_with_journaling}'] Failure: Command failed on smithi040 with status 1: 'sudo yum install -y kernel' 3 jobs: ['7485460', '7485461', '7485467'] suites intersection: ['openstack}'] suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_latest}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests', 'clusters/{fixed-1', 'conf/{disable-pool-app}', 'conf/{disable-pool-app}}', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rbd/basic/{base/install', 'rbd/cli_v1/{base/install', 'rbd/pwl-cache/tmpfs/{1-base/install', 'supported-random-distro$/{centos_latest}', 'tasks/rbd_api_tests_old_format}', 'workloads/rbd_cli_import_export}'] Failure: Command failed (workunit test rbd/test_librbd.sh) on smithi097 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=86ca2652261a3a50668690509bf073959d0391bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=125 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' 1 jobs: ['7485465'] suites: ['clusters/{fixed-3', 'conf/{disable-pool-app}', 'data-pool/ec', 'extra-conf/none', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{centos_latest}', 'workloads/c_api_tests_with_journaling}'] Dead: b'2023-12-10T11:56:54.150 INFO:tasks.workunit.cluster1.client.mirror.smithi137.stderr:+ rbd --cluster cluster2 -p mirror_parent --namespace ns1 ls -l' ceph version 19.0.0-114-g86ca2652 (86ca2652261a3a50668690509bf073959d0391bd) reef (dev) 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fac37ab8520] 2: pthread_kill() 3: raise() 4: abort() 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x17b) [0x559c40b90805] 6: (KernelDevice::_aio_thread()+0x9bc) [0x559c414787fc] 7: ceph-osd(+0x15b40e1) [0x559c4145b0e1] 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fac37b0ab43] 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fac37b9ca00] 1 jobs: ['7485463'] suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}']