2021-04-09T18:50:26.525 INFO:root:teuthology version: 1.1.0-85d61eae
2021-04-09T18:50:26.652 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging
2021-04-09T18:50:26.653 INFO:teuthology.lock.ops:Updating [ubuntu@smithi064.front.sepia.ceph.com]: reset os type and version on server
2021-04-09T18:50:26.653 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2021-04-09T18:50:26.668 INFO:teuthology.lock.ops:Node 'ubuntu@smithi064.front.sepia.ceph.com' reimaging is complete
2021-04-09T18:50:26.668 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi203.front.sepia.ceph.com' reimaging
2021-04-09T18:50:26.669 INFO:teuthology.lock.ops:Updating [ubuntu@smithi203.front.sepia.ceph.com]: reset os type and version on server
2021-04-09T18:50:26.669 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2021-04-09T18:50:26.685 INFO:teuthology.lock.ops:Node 'ubuntu@smithi203.front.sepia.ceph.com' reimaging is complete
2021-04-09T18:50:26.946 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of ubuntu 18.04
2021-04-09T18:50:27.002 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of ubuntu 18.04
2021-04-09T18:50:27.864 INFO:teuthology.orchestra.console:Power off smithi064
2021-04-09T18:50:28.014 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-04-09T18:50:28.035 INFO:teuthology.orchestra.console:Power off smithi203
2021-04-09T18:50:28.116 INFO:teuthology.orchestra.console:Power on smithi064
2021-04-09T18:50:28.180 INFO:teuthology.orchestra.console:Power off for smithi203 completed
2021-04-09T18:50:28.281 INFO:teuthology.orchestra.console:Power on smithi203
2021-04-09T18:50:32.374 INFO:teuthology.orchestra.console:Power on for smithi064 completed
2021-04-09T18:50:32.475 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2021-04-09T18:50:36.652 INFO:teuthology.orchestra.console:Power on for smithi203 completed
2021-04-09T18:50:36.753 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2021-04-09T18:56:32.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-09T18:56:32.737 INFO:teuthology.provision.fog.smithi203:Node is ready
2021-04-09T18:56:32.786 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2021-04-09T18:56:32.835 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2021-04-09T18:56:33.259 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2021-04-09T18:59:00.305 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:01.403 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:02.501 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:03.559 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:04.656 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:05.761 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:06.862 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:07.959 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:09.016 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:10.112 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:16.174 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:17.232 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:18.330 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:19.332 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-04-09T18:59:19.333 ERROR:paramiko.transport:Traceback (most recent call last):
2021-04-09T18:59:19.333 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-04-09T18:59:19.333 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-04-09T18:59:19.334 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-04-09T18:59:19.334 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-04-09T18:59:19.334 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-04-09T18:59:19.335 ERROR:paramiko.transport:    raise EOFError()
2021-04-09T18:59:19.335 ERROR:paramiko.transport:EOFError
2021-04-09T18:59:19.335 ERROR:paramiko.transport:
2021-04-09T18:59:19.336 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-04-09T18:59:19.336 ERROR:paramiko.transport:
2021-04-09T18:59:19.336 ERROR:paramiko.transport:Traceback (most recent call last):
2021-04-09T18:59:19.337 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-04-09T18:59:19.337 ERROR:paramiko.transport:    self._check_banner()
2021-04-09T18:59:19.337 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-04-09T18:59:19.338 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-04-09T18:59:19.338 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-04-09T18:59:19.338 ERROR:paramiko.transport:
2021-04-09T18:59:25.436 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:26.537 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:27.634 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:28.732 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:29.831 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:30.928 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:32.025 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:33.028 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-04-09T18:59:33.028 ERROR:paramiko.transport:Traceback (most recent call last):
2021-04-09T18:59:33.029 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-04-09T18:59:33.029 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-04-09T18:59:33.029 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-04-09T18:59:33.030 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-04-09T18:59:33.030 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-04-09T18:59:33.030 ERROR:paramiko.transport:    raise EOFError()
2021-04-09T18:59:33.031 ERROR:paramiko.transport:EOFError
2021-04-09T18:59:33.031 ERROR:paramiko.transport:
2021-04-09T18:59:33.031 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-04-09T18:59:33.032 ERROR:paramiko.transport:
2021-04-09T18:59:33.032 ERROR:paramiko.transport:Traceback (most recent call last):
2021-04-09T18:59:33.032 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-04-09T18:59:33.033 ERROR:paramiko.transport:    self._check_banner()
2021-04-09T18:59:33.033 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-04-09T18:59:33.033 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-04-09T18:59:33.033 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-04-09T18:59:33.034 ERROR:paramiko.transport:
2021-04-09T18:59:39.130 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:40.229 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:41.328 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:42.424 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:43.521 ERROR:teuthology.orchestra.connection:Error authenticating with smithi064.front.sepia.ceph.com: Authentication failed.
2021-04-09T18:59:44.524 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-04-09T18:59:44.525 ERROR:paramiko.transport:Traceback (most recent call last):
2021-04-09T18:59:44.525 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-04-09T18:59:44.525 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-04-09T18:59:44.526 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-04-09T18:59:44.526 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-04-09T18:59:44.526 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-04-09T18:59:44.527 ERROR:paramiko.transport:    raise EOFError()
2021-04-09T18:59:44.527 ERROR:paramiko.transport:EOFError
2021-04-09T18:59:44.527 ERROR:paramiko.transport:
2021-04-09T18:59:44.528 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-04-09T18:59:44.528 ERROR:paramiko.transport:
2021-04-09T18:59:44.528 ERROR:paramiko.transport:Traceback (most recent call last):
2021-04-09T18:59:44.529 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-04-09T18:59:44.529 ERROR:paramiko.transport:    self._check_banner()
2021-04-09T18:59:44.530 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-04-09T18:59:44.530 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-04-09T18:59:44.530 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-04-09T18:59:44.531 ERROR:paramiko.transport:
2021-04-09T19:01:34.056 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-04-09T19:01:40.063 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-04-09T19:01:47.071 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-04-09T19:01:53.167 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-09T19:01:53.342 INFO:teuthology.provision.fog.smithi064:Node is ready
2021-04-09T19:01:53.384 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064
2021-04-09T19:01:53.425 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064 smithi064
2021-04-09T19:01:53.644 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2021-04-09T19:01:59.899 ERROR:teuthology.misc:write (smithi203.front.sepia.ceph.com): No route to host
2021-04-09T19:02:01.909 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/supervisor.py", line 163, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/lock/ops.py", line 318, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/lock/ops.py", line 285, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/misc.py", line 1103, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi203.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds
2021-04-09T19:02:01.962 INFO:teuthology.nuke:Checking targets against current locks
2021-04-09T19:02:02.061 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-09T19:02:02.073 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-04-09T19:02:02.303 INFO:teuthology.orchestra.console:Power off smithi064
2021-04-09T19:02:02.319 INFO:teuthology.orchestra.console:Power off smithi203
2021-04-09T19:02:14.791 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2021-04-09T19:02:14.798 INFO:teuthology.orchestra.console:Power off for smithi203 completed
2021-04-09T19:02:14.947 INFO:teuthology.lock.ops:unlocked smithi064.front.sepia.ceph.com
2021-04-09T19:02:14.967 INFO:teuthology.lock.ops:unlocked smithi203.front.sepia.ceph.com
2021-04-09T19:02:14.968 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/supervisor.py", line 50, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/supervisor.py", line 163, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/lock/ops.py", line 318, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/lock/ops.py", line 285, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/misc.py", line 1103, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi203.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds