2023-07-22T15:04:37.909 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-22T15:04:37.910 INFO:teuthology.results:subset: '111/120000' 2023-07-22T15:04:37.910 INFO:teuthology.results:seed: '9766' 2023-07-22T15:04:41.879 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-22T15:04:41.880 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-23T03:04:46.882 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-07-23T03:04:47.803 INFO:scrape:Found 9 jobs 2023-07-23T03:04:49.850 INFO:scrape:Found 4 distinct failure reasons 2023-07-23T03:04:49.851 INFO:scrape:Dead: b'2023-07-23T03:04:47.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:47.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24)' 2023-07-23T03:04:49.851 INFO:scrape:1 jobs: ['7348020'] 2023-07-23T03:04:49.851 INFO:scrape:suites: ['clusters/{fixed-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'supported-random-distro$/{rhel_8}', 'workloads/rbd_cli_migration}'] 2023-07-23T03:04:49.852 INFO:scrape: 2023-07-23T03:04:49.852 INFO:scrape:Dead: b"2023-07-23T02:26:31.630 INFO:tasks.workunit.cluster1.client.mirror.smithi032.stderr:+++ rbd --cluster cluster1 -p mirror --namespace '' ls" 2023-07-23T03:04:49.853 INFO:scrape:ceph version 18.1.2-167-g1bf364b9 (1bf364b918a7ab4708130a64bf96639942959f6d) reef (rc) 1: /lib64/libpthread.so.0(+0x12cf0) [0x7fa60b925cf0] 2: gsignal() 3: abort() 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55d8b8a04d81] 5: (KernelDevice::_aio_thread()+0x1798) [0x55d8b9613e68] 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55d8b9616501] 7: /lib64/libpthread.so.0(+0x81ca) [0x7fa60b91b1ca] 8: clone() 2023-07-23T03:04:49.853 INFO:scrape:1 jobs: ['7348028'] 2023-07-23T03:04:49.853 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}'] 2023-07-23T03:04:49.854 INFO:scrape: 2023-07-23T03:04:49.854 INFO:scrape:Failure: Command failed (workunit test rbd/qemu-iotests.sh) on smithi060 with status 13: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bf364b918a7ab4708130a64bf96639942959f6d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/qemu-iotests.sh' 2023-07-23T03:04:49.854 INFO:scrape:1 jobs: ['7348027'] 2023-07-23T03:04:49.855 INFO:scrape:suites: ['objectstore/bluestore-comp-zstd', 'openstack', 'rbd/singleton/{all/qemu-iotests-writeback', 'supported-random-distro$/{centos_latest}}'] 2023-07-23T03:04:49.855 INFO:scrape: 2023-07-23T03:04:49.855 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh 2023-07-23T03:04:49.855 INFO:scrape:1 jobs: ['7348022'] 2023-07-23T03:04:49.856 INFO:scrape:suites: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] 2023-07-23T03:04:49.856 INFO:scrape: