2021-04-22T23:07:58.717 INFO:root:teuthology version: 1.1.0-2713a3cd 2021-04-22T23:07:58.846 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi151.front.sepia.ceph.com' reimaging 2021-04-22T23:07:58.847 INFO:teuthology.lock.ops:Updating [ubuntu@smithi151.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T23:07:58.847 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2021-04-22T23:07:58.861 INFO:teuthology.lock.ops:Node 'ubuntu@smithi151.front.sepia.ceph.com' reimaging is complete 2021-04-22T23:07:58.862 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging 2021-04-22T23:07:58.862 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T23:07:58.862 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2021-04-22T23:07:58.876 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete 2021-04-22T23:07:58.876 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging 2021-04-22T23:07:58.876 INFO:teuthology.lock.ops:Updating [ubuntu@smithi164.front.sepia.ceph.com]: reset os type and version on server 2021-04-22T23:07:58.876 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2021-04-22T23:07:58.890 INFO:teuthology.lock.ops:Node 'ubuntu@smithi164.front.sepia.ceph.com' reimaging is complete 2021-04-22T23:07:59.081 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 8.2 2021-04-22T23:07:59.100 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.2 2021-04-22T23:07:59.115 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.2 2021-04-22T23:07:59.432 INFO:teuthology.orchestra.console:Power off smithi151 2021-04-22T23:07:59.476 INFO:teuthology.orchestra.console:Power off smithi156 2021-04-22T23:07:59.516 INFO:teuthology.orchestra.console:Power off smithi164 2021-04-22T23:07:59.605 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2021-04-22T23:07:59.625 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2021-04-22T23:07:59.707 INFO:teuthology.orchestra.console:Power on smithi151 2021-04-22T23:07:59.733 INFO:teuthology.orchestra.console:Power on smithi156 2021-04-22T23:08:03.957 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2021-04-22T23:08:04.058 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2021-04-22T23:08:08.096 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2021-04-22T23:08:08.197 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2021-04-22T23:08:11.995 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2021-04-22T23:08:12.096 INFO:teuthology.orchestra.console:Power on smithi164 2021-04-22T23:08:16.351 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2021-04-22T23:08:16.451 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2021-04-22T23:12:17.010 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T23:12:37.373 INFO:teuthology.provision.fog.smithi156:Node is ready 2021-04-22T23:12:37.393 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2021-04-22T23:12:37.449 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2021-04-22T23:12:37.681 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T23:12:37.791 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2021-04-22T23:12:50.653 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-22T23:12:50.941 INFO:teuthology.provision.fog.smithi151:Node is ready 2021-04-22T23:12:50.955 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2021-04-22T23:12:51.010 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2021-04-22T23:12:51.338 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2021-04-22T23:12:58.109 INFO:teuthology.provision.fog.smithi164:Node is ready 2021-04-22T23:12:58.168 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2021-04-22T23:12:58.225 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2021-04-22T23:12:58.585 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2021-04-22T23:13:07.722 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/lock/ops.py", line 318, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/lock/ops.py", line 285, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi156.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2021-04-22T23:13:07.772 INFO:teuthology.nuke:Checking targets against current locks 2021-04-22T23:13:07.865 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:13:07.878 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:13:07.889 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-22T23:13:07.982 INFO:teuthology.orchestra.console:Power off smithi156 2021-04-22T23:13:07.997 INFO:teuthology.orchestra.console:Power off smithi151 2021-04-22T23:13:08.010 INFO:teuthology.orchestra.console:Power off smithi164 2021-04-22T23:13:08.142 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2021-04-22T23:13:08.283 INFO:teuthology.lock.ops:unlocked smithi156.front.sepia.ceph.com 2021-04-22T23:13:20.481 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2021-04-22T23:13:20.490 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2021-04-22T23:13:27.228 INFO:teuthology.lock.ops:unlocked smithi151.front.sepia.ceph.com 2021-04-22T23:13:27.245 INFO:teuthology.lock.ops:unlocked smithi164.front.sepia.ceph.com 2021-04-22T23:13:27.246 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 50, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/lock/ops.py", line 318, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/lock/ops.py", line 285, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi156.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds