2024-01-04T17:39:39.223 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2024-01-04T17:39:39.224 INFO:teuthology.results:subset: '111/120000' 2024-01-04T17:39:39.224 INFO:teuthology.results:seed: '6047' 2024-01-05T00:39:19.540 INFO:root:teuthology version: 0.0.1.dev228+g01dd171 2024-01-05T00:39:19.631 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-05T12:40:15.436 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2024-01-05T12:40:16.008 INFO:scrape:Found 6 jobs 2024-01-05T12:40:16.975 INFO:scrape:Found 3 distinct failure reasons 2024-01-05T12:40:16.975 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh 2024-01-05T12:40:16.975 INFO:scrape:1 jobs: ['7507351'] 2024-01-05T12:40:16.975 INFO:scrape:suites: ['clusters/{fixed-1', 'conf/{disable-pool-app}', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd_cli_generic}'] 2024-01-05T12:40:16.975 INFO:scrape: 2024-01-05T12:40:16.975 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh 2024-01-05T12:40:16.975 INFO:scrape:1 jobs: ['7507352'] 2024-01-05T12:40:16.975 INFO:scrape:suites: ['cluster/{fixed-3', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{rhel_8}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] 2024-01-05T12:40:16.976 INFO:scrape: 2024-01-05T12:40:16.976 INFO:scrape:Dead: b'2024-01-05T12:36:04.440 INFO:tasks.workunit.cluster1.client.mirror.smithi124.stderr:++ rbd --cluster cluster2 -p mirror_parent --namespace ns1 mirror pool info' 2024-01-05T12:40:16.976 INFO:scrape:ceph version 17.2.7-217-gfe435bdb (fe435bdb72df5a9eeada79a71a3d8b52fc50a9d2) quincy (stable) 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x5561a64defcf] 2: (KernelDevice::_aio_thread()+0x1699) [0x5561a7199db9] 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5561a719dba1] 4: /lib64/libpthread.so.0(+0x81cf) [0x7fbd33b961cf] 2024-01-05T12:40:16.976 INFO:scrape:1 jobs: ['7507356'] 2024-01-05T12:40:16.976 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}'] 2024-01-05T12:40:16.976 INFO:scrape: