2022-03-28T19:21:58.228 INFO:root:teuthology version: 1.1.0-70390753 2022-03-28T19:21:58.416 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi026.front.sepia.ceph.com' reimaging 2022-03-28T19:21:58.417 INFO:teuthology.lock.ops:Updating [ubuntu@smithi026.front.sepia.ceph.com]: reset os type and version on server 2022-03-28T19:21:58.417 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2022-03-28T19:21:58.437 INFO:teuthology.lock.ops:Node 'ubuntu@smithi026.front.sepia.ceph.com' reimaging is complete 2022-03-28T19:21:58.438 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging 2022-03-28T19:21:58.438 INFO:teuthology.lock.ops:Updating [ubuntu@smithi092.front.sepia.ceph.com]: reset os type and version on server 2022-03-28T19:21:58.439 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2022-03-28T19:21:58.459 INFO:teuthology.lock.ops:Node 'ubuntu@smithi092.front.sepia.ceph.com' reimaging is complete 2022-03-28T19:21:58.460 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging 2022-03-28T19:21:58.460 INFO:teuthology.lock.ops:Updating [ubuntu@smithi154.front.sepia.ceph.com]: reset os type and version on server 2022-03-28T19:21:58.461 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-03-28T19:21:58.481 INFO:teuthology.lock.ops:Node 'ubuntu@smithi154.front.sepia.ceph.com' reimaging is complete 2022-03-28T19:21:58.481 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging 2022-03-28T19:21:58.481 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server 2022-03-28T19:21:58.482 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2022-03-28T19:21:58.503 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete 2022-03-28T19:21:58.668 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of ubuntu 18.04 2022-03-28T19:21:58.671 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of ubuntu 18.04 2022-03-28T19:21:58.689 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of ubuntu 18.04 2022-03-28T19:21:58.711 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of ubuntu 18.04 2022-03-28T19:21:59.012 INFO:teuthology.orchestra.console:Power off smithi092 2022-03-28T19:21:59.052 INFO:teuthology.orchestra.console:Power off smithi154 2022-03-28T19:21:59.069 INFO:teuthology.orchestra.console:Power off smithi190 2022-03-28T19:21:59.101 INFO:teuthology.orchestra.console:Power off smithi026 2022-03-28T19:21:59.164 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2022-03-28T19:21:59.211 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2022-03-28T19:21:59.211 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-03-28T19:21:59.246 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2022-03-28T19:21:59.266 INFO:teuthology.orchestra.console:Power on smithi092 2022-03-28T19:21:59.312 INFO:teuthology.orchestra.console:Power on smithi190 2022-03-28T19:21:59.319 INFO:teuthology.orchestra.console:Power on smithi154 2022-03-28T19:21:59.347 INFO:teuthology.orchestra.console:Power on smithi026 2022-03-28T19:22:03.521 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2022-03-28T19:22:03.571 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2022-03-28T19:22:03.623 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2022-03-28T19:22:03.673 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2022-03-28T19:22:07.678 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2022-03-28T19:22:07.707 INFO:teuthology.orchestra.console:Power on for smithi026 completed 2022-03-28T19:22:07.780 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2022-03-28T19:22:07.808 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2022-03-28T19:26:18.350 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-28T19:26:18.543 INFO:teuthology.provision.fog.smithi026:Node is ready 2022-03-28T19:26:18.589 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2022-03-28T19:26:18.638 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2022-03-28T19:26:18.935 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2022-03-28T19:26:37.120 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:38.150 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:43.138 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:44.162 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:49.154 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:52.229 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:56.197 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:58.196 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:26:58.241 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:27:02.213 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:27:04.253 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:27:04.288 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-28T19:27:04.523 INFO:teuthology.provision.fog.smithi092:Node is ready 2022-03-28T19:27:04.571 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2022-03-28T19:27:04.619 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2022-03-28T19:27:04.919 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2022-03-28T19:27:08.314 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-28T19:27:08.572 INFO:teuthology.provision.fog.smithi190:Node is ready 2022-03-28T19:27:08.620 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2022-03-28T19:27:08.669 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2022-03-28T19:27:08.967 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2022-03-28T19:27:11.284 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-03-28T19:27:17.385 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-28T19:27:17.634 INFO:teuthology.provision.fog.smithi154:Node is ready 2022-03-28T19:27:17.682 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2022-03-28T19:27:17.730 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2022-03-28T19:27:18.012 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2022-03-28T19:27:27.154 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/dispatcher/supervisor.py", line 206, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/lock/ops.py", line 320, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi026.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2022-03-28T19:27:27.220 INFO:teuthology.nuke:Checking targets against current locks 2022-03-28T19:27:27.345 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-28T19:27:27.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-28T19:27:27.351 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-28T19:27:27.352 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-28T19:27:27.429 INFO:teuthology.orchestra.console:Power off smithi092 2022-03-28T19:27:27.446 INFO:teuthology.orchestra.console:Power off smithi190 2022-03-28T19:27:27.458 INFO:teuthology.orchestra.console:Power off smithi026 2022-03-28T19:27:27.470 INFO:teuthology.orchestra.console:Power off smithi154 2022-03-28T19:27:35.829 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2022-03-28T19:27:35.835 INFO:teuthology.orchestra.console:Power off for smithi026 completed 2022-03-28T19:27:35.842 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2022-03-28T19:27:35.848 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-03-28T19:27:35.979 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2022-03-28T19:27:35.984 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2022-03-28T19:27:35.994 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com 2022-03-28T19:27:35.999 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2022-03-28T19:27:36.437 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/dispatcher/supervisor.py", line 52, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/dispatcher/supervisor.py", line 206, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/lock/ops.py", line 320, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi026.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds