Found 246 jobs Missing teuthology log /home/teuthworker/archive/dis-2023-05-18_07:24:53-rbd-wip-rbd-reef-backports-2-distro-default-smithi/7277026/teuthology.log Found 4 distinct failure reasons Dead: None 14 jobs: ['7277026', '7277039', '7277103', '7277035', '7277041', '7277085', '7277059', '7277097', '7277088', '7277001', '7277065', '7277079', '7277061', '7277012'] Dead: b'2023-05-18T19:51:55.261 DEBUG:teuthology.exit:Finished running handlers' ceph version 18.0.0-3137-gb7effb87 (b7effb87b9c2fcd75d268d929fe6c286fb3c1c08) reef (dev) 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f533343fce0] 2: gsignal() 3: abort() 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55e27c9e6ce1] 5: (KernelDevice::_aio_thread()+0x1798) [0x55e27d5f3e38] 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55e27d5f64d1] 7: /lib64/libpthread.so.0(+0x81cf) [0x7f53334351cf] 8: clone() 3 jobs: ['7277134', '7277416', '7277391'] suites intersection: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'openstack}', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install'] suites union: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] Failure: "1684397653.6232045 mon.a (mon.0) 960 : cluster [WRN] Health check failed: Degraded data redundancy: 1/1730 objects degraded (0.058%), 1 pg degraded (PG_DEGRADED)" in cluster log 1 jobs: ['7277099'] suites: ['clusters/{fixed-3', 'config/none', 'min-compat-client/default', 'msgr-failures/few', 'objectstore/bluestore-comp-snappy', 'openstack}', 'pool/small-cache-pool', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests_with_journaling}'] Failure: Command failed on smithi163 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 1 jobs: ['7277229'] suites: ['2-cluster/{fix-2', '3-supported-random-distro$/{ubuntu_20.04}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install']