Found 169 jobs
Missing teuthology log /home/teuthworker/archive/yuriw-2023-10-04_15:48:11-rbd-wip-yuri5-testing-2023-10-02-1105-distro-default-smithi/7410273/teuthology.log
Found 7 distinct failure reasons
Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh
2 jobs: ['7410262', '7410368']
suites intersection: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'msgr-failures/few', 'openstack}', 'rbd/nbd/{base/install', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}']
suites union: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}']

Dead: b'2023-10-05T04:00:19.160 DEBUG:teuthology.exit:Finished running handlers'
1 jobs: ['7410258']
suites: ['clusters/{fixed-1', 'conf/{disable-pool-app}', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd_cli_migration}']

Failure: Command failed on smithi181 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success'
2 jobs: ['7410355', '7410227']
suites intersection: ['2-cluster/{fix-2', '4-cache-path', '5-cache-mode/ssd', '7-workloads/qemu_xfstests', 'conf/{disable-pool-app}}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install']
suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{centos_latest}', '3-supported-random-distro$/{ubuntu_latest}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/1G', '6-cache-size/5G', '7-workloads/qemu_xfstests', 'conf/{disable-pool-app}}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install']

Failure: "2023-10-04T17:20:37.943003+0000 mon.a (mon.0) 859 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log
1 jobs: ['7410304']
suites: ['clusters/{fixed-3', 'conf/{disable-pool-app}', 'extra-conf/permit-partial-discard', 'min-compat-client/octopus', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/replicated-data-pool', 'rbd/librbd/{cache/writeback', 'supported-random-distro$/{ubuntu_latest}', 'workloads/c_api_tests_with_defaults}']

Crash: "2023-10-04T19:39:05.884804+0000 mon.a (mon.0) 1530 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
ceph version 18.0.0-6539-g117cba0ee (117cba0ee546c1ab1abfae99638dc9d28580cdc5) reef (dev)
 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa5d0013520]
 2: pthread_kill()
 3: raise()
 4: abort()
 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x17b) [0x555aee000d29]
 6: (KernelDevice::_aio_thread()+0x9da) [0x555aee8d981a]
 7: ceph-osd(+0x15ad0e1) [0x555aee8da0e1]
 8: /lib/x86_64-linux-gnu/libc.so.6(+0x94b43) [0x7fa5d0065b43]
 9: /lib/x86_64-linux-gnu/libc.so.6(+0x126a00) [0x7fa5d00f7a00]
1 jobs: ['7410386']
suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}']

Dead: None
1 jobs: ['7410273']

Failure: Command crashed: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.1'
1 jobs: ['7410225']
suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-fsx-workunit}']