2023-04-30T17:08:02.231 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-04-30T17:08:02.232 INFO:teuthology.results:seed: '2158'
2023-04-30T17:40:54.928 INFO:root:teuthology version: 0.0.1.dev98+g69caab8
2023-04-30T17:40:54.967 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-04-30T22:16:16.649 INFO:teuthology.results:Tests finished! gathering results...
2023-04-30T22:16:17.939 INFO:scrape:Found 19 jobs
2023-04-30T22:16:18.813 INFO:scrape:Found 5 distinct failure reasons
2023-04-30T22:16:18.814 INFO:scrape:Failure: Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on smithi103 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=135726148d97bd4e65d5b006464f156f7132999b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh'
2023-04-30T22:16:18.814 INFO:scrape:1 jobs: ['7258781']
2023-04-30T22:16:18.814 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}']
2023-04-30T22:16:18.815 INFO:scrape:
2023-04-30T22:16:18.815 INFO:scrape:Failure: Command failed (workunit test rbd/test_lock_fence.sh) on smithi077 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=135726148d97bd4e65d5b006464f156f7132999b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_lock_fence.sh'
2023-04-30T22:16:18.815 INFO:scrape:1 jobs: ['7258792']
2023-04-30T22:16:18.816 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_lock_and_fence}']
2023-04-30T22:16:18.816 INFO:scrape:
2023-04-30T22:16:18.816 INFO:scrape:Failure: {'smithi110.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Failed to download metadata for repo 'CentOS-PowerTools': Yum repo downloading error: Downloading error(s): repodata/740ccb9ea7624357339eebea0914521e886adc610d45c682a443b1c4f3255796-filelists.xml.gz - Cannot download, all mirrors were already tried without success; repodata/38c2c78c3f89e4d347f07263805d33d8ae17df60ebab2e8a259218c57bcae2fb-comps-PowerTools.x86_64.xml - Cannot download, all mirrors were already tried without success", 'rc': 1, 'results': []}}
2023-04-30T22:16:18.817 INFO:scrape:2 jobs: ['7258784', '7258785']
2023-04-30T22:16:18.817 INFO:scrape:suites intersection: ['crimson_qa_overrides', 'deploy/ceph']
2023-04-30T22:16:18.817 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/fixed-1', 'clusters/{fixed-2}', 'crimson-rados/rbd/{centos_latest', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'tasks/rbd_api_tests_old_format}', 'thrashers/default', 'thrashosds-health', 'workloads/radosbench-high-concurrency}']
2023-04-30T22:16:18.817 INFO:scrape:
2023-04-30T22:16:18.818 INFO:scrape:Failure: Command failed (workunit test rbd/test_librbd_python.sh) on smithi057 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=135726148d97bd4e65d5b006464f156f7132999b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'
2023-04-30T22:16:18.818 INFO:scrape:1 jobs: ['7258796']
2023-04-30T22:16:18.818 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_python_api_tests_old_format}']
2023-04-30T22:16:18.819 INFO:scrape:
2023-04-30T22:16:18.819 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh
2023-04-30T22:16:18.819 INFO:scrape:1 jobs: ['7258780']
2023-04-30T22:16:18.819 INFO:scrape:suites: ['clusters/fixed-2', 'crimson-rados/basic/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2023-04-30T22:16:18.820 INFO:scrape: