2023-11-23T16:08:19.667 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T16:08:19.667 INFO:teuthology.results:seed: '4454'
2023-11-23T16:20:42.221 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T16:20:42.225 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-11-24T04:21:31.826 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-11-24T04:21:34.724 INFO:scrape:Found 34 jobs
2023-11-24T04:21:35.986 INFO:scrape:Found 6 distinct failure reasons
2023-11-24T04:21:35.986 INFO:scrape:Dead: b'2023-11-24T04:20:15.518 INFO:teuthology.orchestra.run.smithi102.stderr:2023-11-24T04:20:15.515+0000 7f2d8d224640 -1 WARNING: the following dangerous and experimental features are enabled: crimson'
2023-11-24T04:21:35.986 INFO:scrape:3 jobs: ['7465193', '7465189', '7465195']
2023-11-24T04:21:35.986 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
2023-11-24T04:21:35.986 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}']
2023-11-24T04:21:35.987 INFO:scrape:
2023-11-24T04:21:35.987 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh
2023-11-24T04:21:35.987 INFO:scrape:1 jobs: ['7465166']
2023-11-24T04:21:35.987 INFO:scrape:suites: ['crimson-rados/basic/{clusters/fixed-2', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2023-11-24T04:21:35.987 INFO:scrape:
2023-11-24T04:21:35.987 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh
2023-11-24T04:21:35.987 INFO:scrape:2 jobs: ['7465168', '7465174']
2023-11-24T04:21:35.987 INFO:scrape:suites intersection: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph']
2023-11-24T04:21:35.987 INFO:scrape:suites union: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_api_tests}']
2023-11-24T04:21:35.987 INFO:scrape:
2023-11-24T04:21:35.988 INFO:scrape:Failure: Command failed (workunit test cls/test_cls_rbd.sh) on smithi023 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=14f1647b60acb45d7b342d604fc0cd9fc2b68e4f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh'
2023-11-24T04:21:35.988 INFO:scrape:1 jobs: ['7465180']
2023-11-24T04:21:35.988 INFO:scrape:suites: ['crimson-rados/rbd/{clusters/fixed-1', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_cls_tests}']
2023-11-24T04:21:35.988 INFO:scrape:
2023-11-24T04:21:35.988 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2023-11-24T04:21:35.988 INFO:scrape:1 jobs: ['7465183']
2023-11-24T04:21:35.988 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects-localized}']
2023-11-24T04:21:35.988 INFO:scrape:
2023-11-24T04:21:35.988 INFO:scrape:Dead: b'2023-11-24T04:19:46.266 DEBUG:teuthology.exit:Finished running handlers'
2023-11-24T04:21:35.988 INFO:scrape:2 jobs: ['7465181', '7465172']
2023-11-24T04:21:35.988 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
2023-11-24T04:21:35.989 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson-supported-all-distro/centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/pool-snaps-few-objects}', 'workloads/small-objects-balanced}']
2023-11-24T04:21:35.989 INFO:scrape: