2023-07-06T13:20:03.683 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T13:20:03.684 INFO:teuthology.results:subset: '111/120000' 2023-07-06T13:20:03.684 INFO:teuthology.results:seed: '351' 2023-07-06T13:20:51.097 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T13:20:51.100 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-07T01:21:40.687 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-07-07T01:21:41.405 INFO:scrape:Found 7 jobs 2023-07-07T01:21:43.757 INFO:scrape:Found 5 distinct failure reasons 2023-07-07T01:21:43.758 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/diff_continuous.sh 2023-07-07T01:21:43.759 INFO:scrape:1 jobs: ['7328081'] 2023-07-07T01:21:43.759 INFO:scrape:suites: ['cluster/{fixed-3', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'openstack}', 'rbd/nbd/{base/install', 'supported-random-distro$/{centos_8}', 'thrashers/cache', 'thrashosds-health', 'workloads/rbd_nbd_diff_continuous}'] 2023-07-07T01:21:43.759 INFO:scrape: 2023-07-07T01:21:43.760 INFO:scrape:Dead: b'2023-07-07T01:21:41.353 INFO:tasks.ceph.osd.1.smithi060.stderr:2023-07-07T01:21:41.351+0000 7fb2f183e700 -1 osd.1 26 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4233.0:2495 3.2 3:730838c4:::rbd_data.1086ca169c81.0000000000000010:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3297280~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e25)' 2023-07-07T01:21:43.760 INFO:scrape:1 jobs: ['7328080'] 2023-07-07T01:21:43.760 INFO:scrape:suites: ['clusters/{fixed-1', 'features/layering', 'msgr-failures/few', 'objectstore/bluestore-comp-zstd', 'openstack}', 'pool/small-cache-pool', 'rbd/cli/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd_cli_migration}'] 2023-07-07T01:21:43.760 INFO:scrape: 2023-07-07T01:21:43.761 INFO:scrape:Timeout 120 running ceph --cluster cluster2 pg dump --format=json 2023-07-07T01:21:43.761 INFO:scrape:1 jobs: ['7328085'] 2023-07-07T01:21:43.761 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'msgr-failures/few', 'objectstore/bluestore-stupid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{centos_8}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}'] 2023-07-07T01:21:43.762 INFO:scrape: 2023-07-07T01:21:43.762 INFO:scrape:Failure: Command failed on smithi111 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2023-07-07T01:21:43.762 INFO:scrape:1 jobs: ['7328084'] 2023-07-07T01:21:43.763 INFO:scrape:suites: ['2-cluster/{fix-2', '3-supported-random-distro$/{rhel_8}', '4-cache-path', '5-cache-mode/ssd', '6-cache-size/5G', '7-workloads/qemu_xfstests}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install'] 2023-07-07T01:21:43.763 INFO:scrape: 2023-07-07T01:21:43.763 INFO:scrape:Failure: Command failed on smithi008 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t' 2023-07-07T01:21:43.763 INFO:scrape:1 jobs: ['7328082'] 2023-07-07T01:21:43.764 INFO:scrape:suites: ['base/install', 'cluster/{fixed-3', 'openstack}', 'rbd/iscsi/{0-single-container-host', 'workloads/cephadm_iscsi}'] 2023-07-07T01:21:43.764 INFO:scrape: