2022-02-28T20:49:33.170 INFO:root:teuthology version: 1.1.0-cb5b1a75 2022-02-28T20:49:33.348 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging 2022-02-28T20:49:33.349 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server 2022-02-28T20:49:33.350 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-02-28T20:49:33.373 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete 2022-02-28T20:49:33.374 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging 2022-02-28T20:49:33.374 INFO:teuthology.lock.ops:Updating [ubuntu@smithi092.front.sepia.ceph.com]: reset os type and version on server 2022-02-28T20:49:33.374 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2022-02-28T20:49:33.393 INFO:teuthology.lock.ops:Node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging is complete 2022-02-28T20:49:33.394 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging 2022-02-28T20:49:33.394 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server 2022-02-28T20:49:33.394 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-02-28T20:49:33.418 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete 2022-02-28T20:49:33.603 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of ubuntu 20.04 2022-02-28T20:49:33.644 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of ubuntu 20.04 2022-02-28T20:49:33.650 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 20.04 2022-02-28T20:49:33.953 INFO:teuthology.orchestra.console:Power off smithi036 2022-02-28T20:49:34.021 INFO:teuthology.orchestra.console:Power off smithi156 2022-02-28T20:49:34.084 INFO:teuthology.orchestra.console:Power off smithi092 2022-02-28T20:49:34.130 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-02-28T20:49:34.196 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-02-28T20:49:34.232 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2022-02-28T20:49:34.232 INFO:teuthology.orchestra.console:Power on smithi036 2022-02-28T20:49:34.298 INFO:teuthology.orchestra.console:Power on smithi156 2022-02-28T20:49:34.333 INFO:teuthology.orchestra.console:Power on smithi092 2022-02-28T20:49:42.613 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2022-02-28T20:49:42.672 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2022-02-28T20:49:42.699 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2022-02-28T20:49:42.715 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2022-02-28T20:49:42.774 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2022-02-28T20:49:42.800 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2022-02-28T20:54:13.099 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-28T20:54:13.645 INFO:teuthology.provision.fog.smithi036:Node is ready 2022-02-28T20:54:13.695 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2022-02-28T20:54:13.703 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2022-02-28T20:54:13.871 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2022-02-28T20:54:48.793 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-28T20:54:49.252 INFO:teuthology.provision.fog.smithi092:Node is ready 2022-02-28T20:54:49.259 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2022-02-28T20:54:49.265 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2022-02-28T20:54:49.373 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2022-02-28T20:54:56.632 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-02-28T20:54:57.059 INFO:teuthology.provision.fog.smithi156:Node is ready 2022-02-28T20:54:57.065 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2022-02-28T20:54:57.073 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2022-02-28T20:54:57.261 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2022-02-28T20:54:57.417 ERROR:teuthology.misc:write (smithi092.front.sepia.ceph.com): Connection refused 2022-02-28T20:55:05.449 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/dispatcher/supervisor.py", line 206, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/lock/ops.py", line 316, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi092.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2022-02-28T20:55:05.523 INFO:teuthology.nuke:Checking targets against current locks 2022-02-28T20:55:05.657 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-28T20:55:05.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-28T20:55:05.669 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-28T20:55:05.755 INFO:teuthology.orchestra.console:Power off smithi092 2022-02-28T20:55:05.771 INFO:teuthology.orchestra.console:Power off smithi036 2022-02-28T20:55:05.782 INFO:teuthology.orchestra.console:Power off smithi156 2022-02-28T20:55:05.919 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2022-02-28T20:55:06.062 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2022-02-28T20:55:14.148 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-02-28T20:55:14.301 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2022-02-28T20:55:18.256 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2022-02-28T20:55:18.400 INFO:teuthology.lock.ops:unlocked: smithi036.front.sepia.ceph.com 2022-02-28T20:55:18.695 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/dispatcher/supervisor.py", line 52, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/dispatcher/supervisor.py", line 206, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/lock/ops.py", line 316, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_cb5b1a75970b7aa81700a0ab081943b3146d40d0/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi092.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds