Found 5 jobs Found 4 distinct failure reasons Dead: b'2023-07-08T00:20:02.534 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-08T00:20:02.533+0000 7fe977d2b700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4230.0:6640 3.2 3:53a0b873:::rbd_data.1083d907f8d6.0000000000000015:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1404928~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=2 ondisk+retry+write+known_if_redirected+supports_pool_eio e24)' 1 jobs: ['7328361'] suites: ['clusters/{fixed-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd_cli_migration}'] Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh 1 jobs: ['7328362'] suites: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{centos_8}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] Failure: Command failed on smithi007 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' 1 jobs: ['7328363'] suites: ['base/install', 'cluster/{fixed-3', 'openstack}', 'rbd/iscsi/{0-single-container-host', 'workloads/cephadm_iscsi}'] Dead: b"2023-07-07T23:41:05.420 INFO:tasks.workunit.cluster1.client.mirror.smithi103.stderr:+++ rbd --cluster cluster1 -p mirror --namespace '' ls" ceph version 18.1.0-241-gb75c5422 (b75c542210c04254e2c94e13c158a5b74292e5f0) reef (rc) 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fc20d1a9cf0] 2: gsignal() 3: abort() 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55d727d8fd81] 5: (KernelDevice::_aio_thread()+0x1798) [0x55d72899e888] 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55d7289a0f21] 7: /lib64/libpthread.so.0(+0x81ca) [0x7fc20d19f1ca] 8: clone() 1 jobs: ['7328365'] suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}']