2024-01-19T19:16:47.785 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T19:16:47.785 INFO:teuthology.results:seed: '5203' 2024-01-19T19:27:07.585 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-19T19:27:07.591 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-01-20T07:27:15.944 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2024-01-20T07:27:17.277 INFO:scrape:Found 21 jobs 2024-01-20T07:27:18.493 INFO:scrape:Found 7 distinct failure reasons 2024-01-20T07:27:18.493 INFO:scrape:Dead: b'2024-01-20T07:26:23.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-20T07:26:23.686+0000 7f67d091e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson' 2024-01-20T07:27:18.493 INFO:scrape:4 jobs: ['7523807', '7523803', '7523806', '7523802'] 2024-01-20T07:27:18.494 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health'] 2024-01-20T07:27:18.494 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}'] 2024-01-20T07:27:18.494 INFO:scrape: 2024-01-20T07:27:18.494 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh 2024-01-20T07:27:18.494 INFO:scrape:1 jobs: ['7523790'] 2024-01-20T07:27:18.494 INFO:scrape:suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}'] 2024-01-20T07:27:18.494 INFO:scrape: 2024-01-20T07:27:18.494 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh --crimson 2024-01-20T07:27:18.494 INFO:scrape:1 jobs: ['7523789'] 2024-01-20T07:27:18.494 INFO:scrape:suites: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}'] 2024-01-20T07:27:18.495 INFO:scrape: 2024-01-20T07:27:18.495 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2024-01-20T07:27:18.495 INFO:scrape:2 jobs: ['7523798', '7523794'] 2024-01-20T07:27:18.495 INFO:scrape:suites intersection: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph'] 2024-01-20T07:27:18.495 INFO:scrape:suites union: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_cls_tests}'] 2024-01-20T07:27:18.495 INFO:scrape: 2024-01-20T07:27:18.495 INFO:scrape:Dead: b'2024-01-20T07:26:42.151 DEBUG:teuthology.exit:Finished running handlers' 2024-01-20T07:27:18.495 INFO:scrape:3 jobs: ['7523800', '7523799', '7523793'] 2024-01-20T07:27:18.495 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health'] 2024-01-20T07:27:18.495 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/pool-snaps-few-objects}', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}'] 2024-01-20T07:27:18.496 INFO:scrape: 2024-01-20T07:27:18.496 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd_python.sh -m \ 2024-01-20T07:27:18.496 INFO:scrape:2 jobs: ['7523805', '7523808'] 2024-01-20T07:27:18.496 INFO:scrape:suites intersection: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph'] 2024-01-20T07:27:18.496 INFO:scrape:suites union: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_python_api_tests_old_format}', 'tasks/rbd_python_api_tests}'] 2024-01-20T07:27:18.496 INFO:scrape: 2024-01-20T07:27:18.496 INFO:scrape:Timeout 1h running clone.client.0/qa/workunits/rados/test_python.sh -m \ 2024-01-20T07:27:18.496 INFO:scrape:1 jobs: ['7523797'] 2024-01-20T07:27:18.496 INFO:scrape:suites: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}'] 2024-01-20T07:27:18.496 INFO:scrape: