2024-03-06T15:52:30.145 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-06T15:52:30.146 INFO:teuthology.results:seed: '1872'
2024-03-06T16:07:55.560 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-06T16:07:55.564 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-03-07T04:08:46.791 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2024-03-07T04:08:48.530 INFO:scrape:Found 21 jobs
2024-03-07T04:08:54.963 INFO:scrape:Found 5 distinct failure reasons
2024-03-07T04:08:54.964 INFO:scrape:Failure: Command failed on smithi129 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 2.3 deep-scrub'
2024-03-07T04:08:54.964 INFO:scrape:12 jobs: ['7583511', '7583502', '7583507', '7583504', '7583499', '7583498', '7583516', '7583506', '7583514', '7583500', '7583513', '7583509']
2024-03-07T04:08:54.964 INFO:scrape:suites intersection: ['crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides']
2024-03-07T04:08:54.964 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/basic/{clusters/fixed-2', 'crimson-rados/singleton/{all/osd-backfill', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'rados}', 'tasks/rados_python}', 'tasks/readwrite}', 'thrashers/default', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}', 'workloads/pool-snaps-few-objects}', 'workloads/radosbench-high-concurrency}', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}', 'workloads/small-objects}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}', 'workloads/write_fadvise_dontneed}']
2024-03-07T04:08:54.964 INFO:scrape:
2024-03-07T04:08:54.964 INFO:scrape:Failure: reached maximum tries (501) after waiting for 3000 seconds
2024-03-07T04:08:54.964 INFO:scrape:1 jobs: ['7583503']
2024-03-07T04:08:54.965 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/radosbench}']
2024-03-07T04:08:54.965 INFO:scrape:
2024-03-07T04:08:54.965 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh --crimson
2024-03-07T04:08:54.965 INFO:scrape:1 jobs: ['7583496']
2024-03-07T04:08:54.965 INFO:scrape:suites: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2024-03-07T04:08:54.965 INFO:scrape:
2024-03-07T04:08:54.965 INFO:scrape:Dead: b'2024-03-07T04:07:43.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-03-07T04:07:43.627+0000 7f4a10eed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson'
2024-03-07T04:08:54.965 INFO:scrape:1 jobs: ['7583510']
2024-03-07T04:08:54.965 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/snaps-few-objects-balanced}']
2024-03-07T04:08:54.965 INFO:scrape:
2024-03-07T04:08:54.966 INFO:scrape:Failure: Command failed on smithi181 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ea9a5688d9980e4ddedb59679d2960bcbac6fc71'
2024-03-07T04:08:54.966 INFO:scrape:1 jobs: ['7583497']
2024-03-07T04:08:54.966 INFO:scrape:suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}']
2024-03-07T04:08:54.966 INFO:scrape: