2023-10-12T14:54:21.221 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T14:54:21.222 INFO:teuthology.results:subset: '111/120000' 2023-10-12T14:54:21.222 INFO:teuthology.results:seed: '1319' 2023-10-12T15:01:05.771 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T15:01:05.774 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-12T18:41:23.069 INFO:teuthology.results:Tests finished! gathering results... 2023-10-12T18:41:23.683 INFO:scrape:Found 8 jobs 2023-10-12T18:41:25.538 INFO:scrape:Found 3 distinct failure reasons 2023-10-12T18:41:25.539 INFO:scrape:Crash: "1697126093.3491971 mon.a (mon.0) 1546 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log 2023-10-12T18:41:25.540 INFO:scrape:ceph version 17.2.6-1409-g411b8b72 (411b8b72d6945cb015b753832c1621d9b9d349a6) quincy (stable) 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x5607ae09dd75] 2: (KernelDevice::_aio_thread()+0xe19) [0x5607aed93b09] 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5607aed9ea61] 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f4fb208b609] 2023-10-12T18:41:25.540 INFO:scrape:1 jobs: ['7423421'] 2023-10-12T18:41:25.540 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2023-10-12T18:41:25.541 INFO:scrape: 2023-10-12T18:41:25.541 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-10-12T18:41:25.542 INFO:scrape:2 jobs: ['7423420', '7423414'] 2023-10-12T18:41:25.542 INFO:scrape:suites intersection: ['clusters/{fixed-1', 'conf/{disable-pool-app}', 'msgr-failures/few', 'openstack}', 'pool/small-cache-pool', 'workloads/rbd_cli_generic}'] 2023-10-12T18:41:25.543 INFO:scrape:suites union: ['clusters/{fixed-1', 'conf/{disable-pool-app}', 'features/format-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd_cli_generic}'] 2023-10-12T18:41:25.543 INFO:scrape: 2023-10-12T18:41:25.543 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2023-10-12T18:41:25.544 INFO:scrape:1 jobs: ['7423416'] 2023-10-12T18:41:25.544 INFO:scrape:suites: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] 2023-10-12T18:41:25.545 INFO:scrape: