2021-06-12T13:08:07.533 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-12T13:08:08.673 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging 2021-06-12T13:08:08.674 INFO:teuthology.lock.ops:Updating [ubuntu@smithi016.front.sepia.ceph.com]: reset os type and version on server 2021-06-12T13:08:08.674 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2021-06-12T13:08:08.696 INFO:teuthology.lock.ops:Node 'ubuntu@smithi016.front.sepia.ceph.com' reimaging is complete 2021-06-12T13:08:08.696 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi038.front.sepia.ceph.com' reimaging 2021-06-12T13:08:08.697 INFO:teuthology.lock.ops:Updating [ubuntu@smithi038.front.sepia.ceph.com]: reset os type and version on server 2021-06-12T13:08:08.697 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2021-06-12T13:08:08.713 INFO:teuthology.lock.ops:Node 'ubuntu@smithi038.front.sepia.ceph.com' reimaging is complete 2021-06-12T13:08:08.713 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging 2021-06-12T13:08:08.713 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server 2021-06-12T13:08:08.714 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2021-06-12T13:08:08.728 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete 2021-06-12T13:08:09.527 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.3 2021-06-12T13:08:10.128 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.3 2021-06-12T13:08:10.215 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of centos 8.3 2021-06-12T13:08:18.020 INFO:teuthology.orchestra.console:Power off smithi016 2021-06-12T13:08:18.083 INFO:teuthology.orchestra.console:Power off smithi038 2021-06-12T13:08:18.168 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-06-12T13:08:18.220 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2021-06-12T13:08:18.270 INFO:teuthology.orchestra.console:Power on smithi016 2021-06-12T13:08:18.321 INFO:teuthology.orchestra.console:Power on smithi038 2021-06-12T13:08:18.888 INFO:teuthology.orchestra.console:Power off smithi082 2021-06-12T13:08:19.025 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2021-06-12T13:08:19.126 INFO:teuthology.orchestra.console:Power on smithi082 2021-06-12T13:08:22.519 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2021-06-12T13:08:22.567 INFO:teuthology.orchestra.console:Power on for smithi038 completed 2021-06-12T13:08:22.621 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2021-06-12T13:08:22.668 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2021-06-12T13:08:27.482 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2021-06-12T13:08:27.583 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2021-06-12T13:14:07.790 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-12T13:14:08.114 INFO:teuthology.provision.fog.smithi082:Node is ready 2021-06-12T13:14:08.129 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com 2021-06-12T13:14:08.184 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082 2021-06-12T13:14:08.513 INFO:teuthology.provision.fog.smithi082:Deploy complete! 2021-06-12T13:14:19.822 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-12T13:14:20.178 INFO:teuthology.provision.fog.smithi038:Node is ready 2021-06-12T13:14:20.194 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2021-06-12T13:14:20.249 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2021-06-12T13:14:20.590 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2021-06-12T13:15:02.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-12T13:15:17.070 INFO:teuthology.provision.fog.smithi016:Node is ready 2021-06-12T13:15:17.090 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2021-06-12T13:15:17.149 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2021-06-12T13:15:17.530 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2021-06-12T13:15:17.638 ERROR:teuthology.misc:write (smithi038.front.sepia.ceph.com): Connection refused 2021-06-12T13:15:18.647 ERROR:teuthology.misc:write (smithi038.front.sepia.ceph.com): Connection refused 2021-06-12T13:15:19.656 ERROR:teuthology.misc:write (smithi038.front.sepia.ceph.com): Connection refused 2021-06-12T13:15:20.663 ERROR:teuthology.misc:write (smithi038.front.sepia.ceph.com): Connection refused 2021-06-12T13:15:21.670 ERROR:teuthology.misc:write (smithi038.front.sepia.ceph.com): Connection refused 2021-06-12T13:15:21.671 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 318, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 285, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi038.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2021-06-12T13:15:21.716 INFO:teuthology.nuke:Checking targets against current locks 2021-06-12T13:15:21.802 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-12T13:15:21.806 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-12T13:15:21.807 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-12T13:15:21.868 INFO:teuthology.orchestra.console:Power off smithi016 2021-06-12T13:15:21.884 INFO:teuthology.orchestra.console:Power off smithi038 2021-06-12T13:15:21.896 INFO:teuthology.orchestra.console:Power off smithi082 2021-06-12T13:15:30.259 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2021-06-12T13:15:30.266 INFO:teuthology.orchestra.console:Power off for smithi038 completed 2021-06-12T13:15:30.399 INFO:teuthology.lock.ops:unlocked smithi016.front.sepia.ceph.com 2021-06-12T13:15:30.402 INFO:teuthology.lock.ops:unlocked smithi038.front.sepia.ceph.com 2021-06-12T13:15:34.381 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2021-06-12T13:15:34.524 INFO:teuthology.lock.ops:unlocked smithi082.front.sepia.ceph.com 2021-06-12T13:15:34.525 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 50, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 318, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 285, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi038.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds