2023-03-19T14:31:43.925 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3
2023-03-19T14:31:46.785 INFO:teuthology.results:seed: '3997'
2023-03-19T15:35:14.447 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3
2023-03-19T15:35:16.069 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-03-20T03:36:06.367 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-03-20T03:36:09.875 INFO:scrape:Found 18 jobs
2023-03-20T03:36:12.592 INFO:scrape:Found 8 distinct failure reasons
2023-03-20T03:36:13.846 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_lock_fence.sh
2023-03-20T03:36:13.846 INFO:scrape:1 jobs: ['7213708']
2023-03-20T03:36:13.846 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_lock_and_fence}']
2023-03-20T03:36:13.847 INFO:scrape:
2023-03-20T03:36:13.847 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh
2023-03-20T03:36:13.847 INFO:scrape:1 jobs: ['7213698']
2023-03-20T03:36:13.847 INFO:scrape:suites: ['clusters/fixed-2', 'crimson-rados/basic/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2023-03-20T03:36:13.847 INFO:scrape:
2023-03-20T03:36:13.847 INFO:scrape:Timeout 1h running clone.client.0/qa/workunits/rados/test_python.sh --eval-attr \
2023-03-20T03:36:13.848 INFO:scrape:1 jobs: ['7213705']
2023-03-20T03:36:13.848 INFO:scrape:suites: ['clusters/fixed-2', 'crimson-rados/basic/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}']
2023-03-20T03:36:13.848 INFO:scrape:
2023-03-20T03:36:13.848 INFO:scrape:Dead: b'2023-03-20T03:31:10.999 DEBUG:teuthology.exit:Finished running handlers'
2023-03-20T03:36:13.848 INFO:scrape:2 jobs: ['7213710', '7213701']
2023-03-20T03:36:13.848 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
2023-03-20T03:36:13.849 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/pool-snaps-few-objects}', 'workloads/snaps-few-objects-balanced}']
2023-03-20T03:36:13.849 INFO:scrape:
2023-03-20T03:36:13.849 INFO:scrape:Dead: b'2023-03-20T03:34:14.827 INFO:teuthology.orchestra.run.smithi060.stderr:2023-03-20T03:34:14.825+0000 7f6762732700 -1 WARNING: the following dangerous and experimental features are enabled: crimson'
2023-03-20T03:36:13.849 INFO:scrape:2 jobs: ['7213712', '7213714']
2023-03-20T03:36:13.849 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
2023-03-20T03:36:13.850 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}']
2023-03-20T03:36:13.850 INFO:scrape:
2023-03-20T03:36:13.850 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd_python.sh
2023-03-20T03:36:13.850 INFO:scrape:1 jobs: ['7213713']
2023-03-20T03:36:13.850 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_python_api_tests_old_format}']
2023-03-20T03:36:13.850 INFO:scrape:
2023-03-20T03:36:13.850 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh
2023-03-20T03:36:13.851 INFO:scrape:1 jobs: ['7213699']
2023-03-20T03:36:13.851 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests_old_format}']
2023-03-20T03:36:13.851 INFO:scrape:
2023-03-20T03:36:13.851 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2023-03-20T03:36:13.851 INFO:scrape:1 jobs: ['7213703']
2023-03-20T03:36:13.851 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_cls_tests}']
2023-03-20T03:36:13.851 INFO:scrape: