2024-02-19T20:27:02.924 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-02-19T20:27:02.924 INFO:teuthology.results:subset: '111/120000'
2024-02-19T20:27:02.924 INFO:teuthology.results:seed: '8463'
2024-02-19T20:28:26.260 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-02-19T20:28:26.264 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-02-20T01:30:49.716 INFO:teuthology.results:Tests finished! gathering results...
2024-02-20T01:30:50.366 INFO:scrape:Found 8 jobs
2024-02-20T01:30:51.943 INFO:scrape:Found 2 distinct failure reasons
2024-02-20T01:30:51.944 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/cli_generic.sh
2024-02-20T01:30:51.944 INFO:scrape:1 jobs: ['7566697']
2024-02-20T01:30:51.944 INFO:scrape:suites: ['clusters/{fixed-1', 'features/format-1', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'pool/small-cache-pool', 'rbd/cli_v1/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd_cli_generic}']
2024-02-20T01:30:51.944 INFO:scrape:
2024-02-20T01:30:51.944 INFO:scrape:Crash: Command failed (workunit test rbd/rbd_mirror_stress.sh) on smithi192 with status 110: 'mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=81bd20d634209c7cb82c18be12b4b5a05643ebf1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS=\'\' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock,object-map,fast-diff RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh'
2024-02-20T01:30:51.944 INFO:scrape:ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)
 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x55f952aa4e38]
 2: (KernelDevice::_aio_thread()+0x1254) [0x55f9536126e4]
 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f95361db81]
 4: /lib64/libpthread.so.0(+0x81ca) [0x7f7bb07671ca]
2024-02-20T01:30:51.944 INFO:scrape:2 jobs: ['7566703', '7566700']
2024-02-20T01:30:51.944 INFO:scrape:suites intersection: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'openstack}', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}']
2024-02-20T01:30:51.945 INFO:scrape:suites union: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'policy/none', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}']
2024-02-20T01:30:51.945 INFO:scrape: