2021-06-18T15:15:31.930 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-18T15:15:32.056 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging 2021-06-18T15:15:32.057 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server 2021-06-18T15:15:32.057 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server 2021-06-18T15:15:32.080 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete 2021-06-18T15:15:32.080 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging 2021-06-18T15:15:32.081 INFO:teuthology.lock.ops:Updating [ubuntu@smithi169.front.sepia.ceph.com]: reset os type and version on server 2021-06-18T15:15:32.082 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2021-06-18T15:15:32.099 INFO:teuthology.lock.ops:Node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging is complete 2021-06-18T15:15:32.100 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging 2021-06-18T15:15:32.100 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server 2021-06-18T15:15:32.101 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2021-06-18T15:15:32.116 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete 2021-06-18T15:15:32.620 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 18.04 2021-06-18T15:15:32.705 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of ubuntu 18.04 2021-06-18T15:15:32.844 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 18.04 2021-06-18T15:15:34.707 INFO:teuthology.orchestra.console:Power off smithi183 2021-06-18T15:15:34.790 INFO:teuthology.orchestra.console:Power off smithi058 2021-06-18T15:15:34.850 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-06-18T15:15:34.936 INFO:teuthology.orchestra.console:Power off for smithi058 completed 2021-06-18T15:15:34.947 INFO:teuthology.orchestra.console:Power off smithi169 2021-06-18T15:15:34.955 INFO:teuthology.orchestra.console:Power on smithi183 2021-06-18T15:15:35.038 INFO:teuthology.orchestra.console:Power on smithi058 2021-06-18T15:15:35.090 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2021-06-18T15:15:35.191 INFO:teuthology.orchestra.console:Power on smithi169 2021-06-18T15:15:43.324 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2021-06-18T15:15:43.426 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2021-06-18T15:15:43.529 INFO:teuthology.orchestra.console:Power on for smithi058 completed 2021-06-18T15:15:43.551 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2021-06-18T15:15:43.630 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish 2021-06-18T15:15:43.653 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2021-06-18T15:27:56.280 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-06-18T15:28:02.327 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-06-18T15:28:14.383 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-06-18T15:28:20.473 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-18T15:28:20.860 INFO:teuthology.provision.fog.smithi058:Node is ready 2021-06-18T15:28:20.910 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com 2021-06-18T15:28:20.958 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058 2021-06-18T15:28:21.288 INFO:teuthology.provision.fog.smithi058:Deploy complete! 2021-06-18T15:28:22.248 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-06-18T15:28:28.327 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-18T15:28:28.524 INFO:teuthology.provision.fog.smithi183:Node is ready 2021-06-18T15:28:28.571 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183 2021-06-18T15:28:28.619 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183 smithi183 2021-06-18T15:28:28.947 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2021-06-18T15:28:49.753 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-06-18T15:28:50.104 INFO:teuthology.provision.fog.smithi169:Node is ready 2021-06-18T15:28:50.151 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2021-06-18T15:28:50.204 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2021-06-18T15:28:50.523 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2021-06-18T15:28:59.713 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 318, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 285, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi183.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2021-06-18T15:28:59.813 INFO:teuthology.nuke:Checking targets against current locks 2021-06-18T15:28:59.946 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-18T15:28:59.948 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-18T15:28:59.951 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-06-18T15:29:00.016 INFO:teuthology.orchestra.console:Power off smithi169 2021-06-18T15:29:00.033 INFO:teuthology.orchestra.console:Power off smithi058 2021-06-18T15:29:00.046 INFO:teuthology.orchestra.console:Power off smithi183 2021-06-18T15:29:08.420 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2021-06-18T15:29:08.559 INFO:teuthology.lock.ops:unlocked smithi169.front.sepia.ceph.com 2021-06-18T15:29:12.525 INFO:teuthology.orchestra.console:Power off for smithi058 completed 2021-06-18T15:29:12.535 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2021-06-18T15:29:12.666 INFO:teuthology.lock.ops:unlocked smithi058.front.sepia.ceph.com 2021-06-18T15:29:12.673 INFO:teuthology.lock.ops:unlocked smithi183.front.sepia.ceph.com 2021-06-18T15:29:12.673 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 50, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 318, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 285, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi183.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds