2024-03-06T13:12:41.276 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-06T13:12:41.277 INFO:teuthology.results:seed: '1634'
2024-03-06T13:59:22.846 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-03-06T13:59:22.850 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-03-06T16:53:36.732 INFO:teuthology.results:Tests finished! gathering results...
2024-03-06T16:53:40.525 INFO:scrape:Found 60 jobs
2024-03-06T16:53:42.057 INFO:scrape:Found 5 distinct failure reasons
2024-03-06T16:53:42.057 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2024-03-06T16:53:42.057 INFO:scrape:6 jobs: ['7583304', '7583308', '7583303', '7583301', '7583309', '7583319']
2024-03-06T16:53:42.057 INFO:scrape:suites intersection: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}']
2024-03-06T16:53:42.057 INFO:scrape:suites union: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}']
2024-03-06T16:53:42.057 INFO:scrape:
2024-03-06T16:53:42.058 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh --crimson
2024-03-06T16:53:42.058 INFO:scrape:17 jobs: ['7583292', '7583293', '7583289', '7583288', '7583299', '7583290', '7583297', '7583285', '7583280', '7583295', '7583287', '7583281', '7583296', '7583291', '7583286', '7583283', '7583298']
2024-03-06T16:53:42.058 INFO:scrape:suites intersection: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2024-03-06T16:53:42.058 INFO:scrape:suites union: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2024-03-06T16:53:42.058 INFO:scrape:
2024-03-06T16:53:42.058 INFO:scrape:Timeout 1h running clone.client.0/qa/workunits/rados/test_python.sh -m \
2024-03-06T16:53:42.058 INFO:scrape:10 jobs: ['7583311', '7583314', '7583310', '7583317', '7583321', '7583316', '7583307', '7583302', '7583312', '7583305']
2024-03-06T16:53:42.058 INFO:scrape:suites intersection: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}']
2024-03-06T16:53:42.059 INFO:scrape:suites union: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}']
2024-03-06T16:53:42.059 INFO:scrape:
2024-03-06T16:53:42.059 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson'
2024-03-06T16:53:42.059 INFO:scrape:3 jobs: ['7583284', '7583282', '7583294']
2024-03-06T16:53:42.059 INFO:scrape:suites intersection: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2024-03-06T16:53:42.059 INFO:scrape:suites union: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2024-03-06T16:53:42.059 INFO:scrape:
2024-03-06T16:53:42.059 INFO:scrape:Timeout 120 running ceph --cluster ceph status --format=json
2024-03-06T16:53:42.059 INFO:scrape:1 jobs: ['7583318']
2024-03-06T16:53:42.059 INFO:scrape:suites: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_python}']
2024-03-06T16:53:42.059 INFO:scrape: