Found 181 jobs
Missing teuthology log /home/teuthworker/archive/yuriw-2023-12-22_19:47:23-rbd-wip-yuri4-testing-2023-12-21-0917-quincy-distro-default-smithi/7499684/teuthology.log
Found 6 distinct failure reasons
Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh
2 jobs: ['7499714', '7499647']
suites intersection: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'msgr-failures/few', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}']
suites union: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'objectstore/filestore-xfs', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}']

Failure: Command failed on smithi196 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'
4 jobs: ['7499670', '7499759', '7499792', '7499664']
suites intersection: ['openstack}']
suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_8}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests', 'cluster/{fixed-3', 'clusters/{fixed-3', 'conf/{disable-pool-app}', 'conf/{disable-pool-app}}', 'features/defaults', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'openstack}', 'pool/small-cache-pool', 'qemu/xfstests', 'rbd/encryption/{cache/writearound', 'rbd/maintenance/{base/install', 'rbd/nbd/{base/install', 'rbd/pwl-cache/tmpfs/{1-base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/dynamic_features_no_cache}', 'workloads/qemu_xfstests_luks2}', 'workloads/rbd_nbd_diff_continuous}']

Dead: None
5 jobs: ['7499684', '7499658', '7499699', '7499650', '7499651']

Crash: "1703287203.7719197 mon.a (mon.0) 1571 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
ceph version 17.2.7-168-g5e7ce129 (5e7ce1294a22dbbbddee64f3a18ddd2050b07f8f) quincy (stable)
 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xd7) [0x560f0c7c1efb]
 2: (KernelDevice::_aio_thread()+0x1699) [0x560f0d47c719]
 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x560f0d480501]
 4: /lib64/libpthread.so.0(+0x81cf) [0x7f2da33651cf]
1 jobs: ['7499779']
suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}']

Failure: failed to install new kernel version within timeout
1 jobs: ['7499662']
suites: ['clusters/{fixed-1', 'conf/{disable-pool-app}', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd_cli_generic}']

Failure: ['E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 15995 (apt-get)']
1 jobs: ['7499716']
suites: ['clusters/{fixed-2', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'rbd/thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/journal}']