2021-03-24T21:27:04.148 INFO:root:teuthology version: 1.1.0-6b3150e9 2021-03-24T21:27:04.151 INFO:teuthology.results:subset: '111/999' 2021-03-24T21:27:04.151 INFO:teuthology.results:seed: '8729' 2021-03-24T21:55:59.282 INFO:root:teuthology version: 1.1.0-6b3150e9 2021-03-24T21:55:59.317 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-03-24T22:10:00.415 INFO:teuthology.results:Tests finished! gathering results... 2021-03-24T22:10:02.397 INFO:scrape:Found 61 jobs 2021-03-24T22:10:03.337 INFO:scrape:Found 6 distinct failure reasons 2021-03-24T22:10:03.338 INFO:scrape:Failure: Command failed on smithi190 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:d71e96d216190f28f757f409532464ab0eca4ea9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dedc6756-8ce9-11eb-90b2-001a4aab830c -- ceph orch host ls --format=json' 2021-03-24T22:10:03.339 INFO:scrape:2 jobs: ['5995063', '5995056'] 2021-03-24T22:10:03.339 INFO:scrape:suites intersection: ['fixed-2', 'start}'] 2021-03-24T22:10:03.340 INFO:scrape:suites union: ['fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados:cephadm/smoke/{distro/ubuntu_20.04_kubic_stable', 'rados:cephadm/smoke/{distro/ubuntu_20.04_kubic_testing', 'start}'] 2021-03-24T22:10:03.340 INFO:scrape: 2021-03-24T22:10:03.341 INFO:scrape:Dead: b'2021-03-24T22:07:19.177 DEBUG:teuthology.exit:Finished running handlers' 2021-03-24T22:10:03.341 INFO:scrape:36 jobs 2021-03-24T22:10:03.342 INFO:scrape:suites intersection: [] 2021-03-24T22:10:03.343 INFO:scrape:suites union: ['1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-start', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '2-services/basic', '2-services/mirror', '2-services/rgw', '2-thrash', '3-final}', '3-start-upgrade', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '4-wait', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'rados', 'rados:cephadm/smoke-roleless/{0-distro/rhel_8.3_kubic_stable', 'rados:cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados:cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'rados:cephadm/smoke/{distro/centos_8.2_kubic_stable', 'rados:cephadm/smoke/{distro/rhel_8.3_kubic_stable', 'rados:cephadm/smoke/{distro/ubuntu_18.04', 'rados:cephadm/smoke/{distro/ubuntu_20.04_kubic_stable', 'rados:cephadm/smoke/{distro/ubuntu_20.04_kubic_testing', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados:cephadm/thrash/{0-distro/centos_8.2_kubic_stable', 'rados:cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable', 'rados:cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing', 'rados:cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus', 'rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'rados:cephadm/with-work/{0-distro/centos_8.2_kubic_stable', 'rados:cephadm/with-work/{0-distro/ubuntu_18.04', 'rados:cephadm/with-work/{0-distro/ubuntu_20.04_kubic_stable', 'rados:cephadm/with-work/{0-distro/ubuntu_20.04_kubic_testing', 'rados:cephadm/workunits/{0-distro/centos_8.2_kubic_stable', 'rados:cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable', 'rados:cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing', 'root}', 'start', 'start}', 'task/test_adoption}', 'task/test_cephadm}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2021-03-24T22:10:03.343 INFO:scrape: 2021-03-24T22:10:03.344 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi064 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d71e96d216190f28f757f409532464ab0eca4ea9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-03-24T22:10:03.344 INFO:scrape:1 jobs: ['5995065'] 2021-03-24T22:10:03.344 INFO:scrape:suites: ['rados:cephadm/dashboard/{0-distro/centos_8.2_kubic_stable', 'task/test_e2e}'] 2021-03-24T22:10:03.345 INFO:scrape: 2021-03-24T22:10:03.345 INFO:scrape:Failure: failed to install new kernel version within timeout 2021-03-24T22:10:03.346 INFO:scrape:1 jobs: ['5995080'] 2021-03-24T22:10:03.346 INFO:scrape:suites: ['1-install/mimic-v1only', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'msgr-failures/fastclose', 'rados', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}'] 2021-03-24T22:10:03.347 INFO:scrape: 2021-03-24T22:10:03.347 INFO:scrape:Failure: {'Failure object was': {'smithi014.front.sepia.ceph.com': {'msg': 'Failed to update apt cache: ', 'invocation': {'module_args': {'dpkg_options': 'force-confdef,force-confold', 'autoremove': False, 'force': False, 'force_apt_get': False, 'policy_rc_d': 'None', 'package': 'None', 'autoclean': False, 'install_recommends': 'None', 'purge': False, 'allow_unauthenticated': False, 'state': 'present', 'upgrade': 'None', 'update_cache': True, 'default_release': 'None', 'only_upgrade': False, 'deb': 'None', 'cache_valid_time': 0}}, '_ansible_no_log': False, 'attempts': 24, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '_ansible_no_log')"} 2021-03-24T22:10:03.348 INFO:scrape:1 jobs: ['5995088'] 2021-03-24T22:10:03.348 INFO:scrape:suites: ['fixed-2', 'mode/packaged', 'mon_election/connectivity', 'msgr/async-v1only', 'rados:cephadm/with-work/{0-distro/ubuntu_20.04', 'start', 'tasks/rados_python}'] 2021-03-24T22:10:03.348 INFO:scrape: 2021-03-24T22:10:03.349 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d71e96d216190f28f757f409532464ab0eca4ea9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-03-24T22:10:03.349 INFO:scrape:1 jobs: ['5995073'] 2021-03-24T22:10:03.350 INFO:scrape:suites: ['mon_election/classic', 'rados:cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable', 'task/test_cephadm}'] 2021-03-24T22:10:03.350 INFO:scrape: