2022-10-11T20:30:32.956 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-11T20:30:32.958 INFO:teuthology.results:subset: '111/120000'
2022-10-11T20:30:32.958 INFO:teuthology.results:seed: '9229'
2022-10-11T20:38:59.492 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-11T20:38:59.495 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-10-12T08:39:53.473 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2022-10-12T08:39:54.297 INFO:scrape:Found 10 jobs
2022-10-12T08:39:56.005 INFO:scrape:Found 7 distinct failure reasons
2022-10-12T08:39:56.006 INFO:scrape:Dead: b'2022-10-12T08:38:30.270 DEBUG:teuthology.exit:Finished running handlers'
2022-10-12T08:39:56.006 INFO:scrape:1 jobs: ['7063170']
2022-10-12T08:39:56.007 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}']
2022-10-12T08:39:56.007 INFO:scrape:
2022-10-12T08:39:56.008 INFO:scrape:Failure: 'pool'
2022-10-12T08:39:56.008 INFO:scrape:2 jobs: ['7063169', '7063174']
2022-10-12T08:39:56.009 INFO:scrape:suites intersection: ['0-start', '1-tasks', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2022-10-12T08:39:56.009 INFO:scrape:suites union: ['0-start', '1-tasks', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'rados/upgrade/parallel/{0-random-distro$/{ubuntu_20.04}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default']
2022-10-12T08:39:56.010 INFO:scrape:
2022-10-12T08:39:56.010 INFO:scrape:Failure: {'smithi017.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}}
2022-10-12T08:39:56.010 INFO:scrape:1 jobs: ['7063176']
2022-10-12T08:39:56.011 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}']
2022-10-12T08:39:56.011 INFO:scrape:
2022-10-12T08:39:56.012 INFO:scrape:Failure: "1665521575.2801657 mgr.x (mgr.4101) 88 : cluster [ERR] Unhandled exception from module 'balancer' while running on mgr.x: ('pool',)" in cluster log
2022-10-12T08:39:56.012 INFO:scrape:2 jobs: ['7063177', '7063175']
2022-10-12T08:39:56.013 INFO:scrape:suites intersection: ['mon_election/connectivity', 'rados']
2022-10-12T08:39:56.013 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/verify/{centos_latest', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}']
2022-10-12T08:39:56.014 INFO:scrape:
2022-10-12T08:39:56.014 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
2022-10-12T08:39:56.015 INFO:scrape:1 jobs: ['7063171']
2022-10-12T08:39:56.015 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}']
2022-10-12T08:39:56.016 INFO:scrape:
2022-10-12T08:39:56.016 INFO:scrape:Failure: {'smithi179.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['krb5-workstation'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': True}}, 'msg': "Loading repository 'rhel-8-for-x86_64-baseos-rpms' has failed", 'rc': 1, 'results': []}}
2022-10-12T08:39:56.017 INFO:scrape:1 jobs: ['7063172']
2022-10-12T08:39:56.017 INFO:scrape:suites: ['mon_election/classic', 'rados', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'supported-random-distro$/{rhel_8}}']
2022-10-12T08:39:56.018 INFO:scrape:
2022-10-12T08:39:56.018 INFO:scrape:Failure: Command failed on smithi079 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'
2022-10-12T08:39:56.019 INFO:scrape:2 jobs: ['7063168', '7063173']
2022-10-12T08:39:56.019 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', 'cluster/1-node', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}']
2022-10-12T08:39:56.020 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}']
2022-10-12T08:39:56.020 INFO:scrape: