2021-06-23T12:23:23.201 INFO:root:teuthology version: 1.1.0-f359b10d
2021-06-23T12:23:23.300 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba016.front.sepia.ceph.com' reimaging
2021-06-23T12:23:23.302 INFO:teuthology.lock.ops:Updating [ubuntu@gibba016.front.sepia.ceph.com]: reset os type and version on server
2021-06-23T12:23:23.302 INFO:teuthology.lock.ops:Updating gibba016.front.sepia.ceph.com on lock server
2021-06-23T12:23:23.316 INFO:teuthology.lock.ops:Node 'ubuntu@gibba016.front.sepia.ceph.com' reimaging is complete
2021-06-23T12:23:23.316 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba041.front.sepia.ceph.com' reimaging
2021-06-23T12:23:23.316 INFO:teuthology.lock.ops:Updating [ubuntu@gibba041.front.sepia.ceph.com]: reset os type and version on server
2021-06-23T12:23:23.317 INFO:teuthology.lock.ops:Updating gibba041.front.sepia.ceph.com on lock server
2021-06-23T12:23:23.330 INFO:teuthology.lock.ops:Node 'ubuntu@gibba041.front.sepia.ceph.com' reimaging is complete
2021-06-23T12:23:23.515 INFO:teuthology.provision.fog.gibba016:Scheduling deploy of rhel 8.3
2021-06-23T12:23:23.540 INFO:teuthology.provision.fog.gibba041:Scheduling deploy of rhel 8.3
2021-06-23T12:23:23.883 INFO:teuthology.orchestra.console:Power off gibba041
2021-06-23T12:23:23.921 INFO:teuthology.orchestra.console:Power off gibba016
2021-06-23T12:23:24.032 INFO:teuthology.orchestra.console:Power off for gibba041 completed
2021-06-23T12:23:24.100 INFO:teuthology.orchestra.console:Power off for gibba016 completed
2021-06-23T12:23:24.134 INFO:teuthology.orchestra.console:Power on gibba041
2021-06-23T12:23:24.201 INFO:teuthology.orchestra.console:Power on gibba016
2021-06-23T12:23:28.458 INFO:teuthology.orchestra.console:Power on for gibba016 completed
2021-06-23T12:23:28.560 INFO:teuthology.provision.fog.gibba016:Waiting for deploy to finish
2021-06-23T12:23:32.510 INFO:teuthology.orchestra.console:Power on for gibba041 completed
2021-06-23T12:23:32.611 INFO:teuthology.provision.fog.gibba041:Waiting for deploy to finish
2021-06-23T12:27:10.375 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:11.434 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:12.529 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:13.625 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:14.721 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:15.816 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:16.911 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:18.006 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:19.101 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:20.195 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:26.198 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-06-23T12:27:26.200 ERROR:paramiko.transport:Traceback (most recent call last):
2021-06-23T12:27:26.200 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-06-23T12:27:26.200 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-06-23T12:27:26.201 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-06-23T12:27:26.201 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-06-23T12:27:26.201 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-06-23T12:27:26.202 ERROR:paramiko.transport:    raise EOFError()
2021-06-23T12:27:26.202 ERROR:paramiko.transport:EOFError
2021-06-23T12:27:26.202 ERROR:paramiko.transport:
2021-06-23T12:27:26.203 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-06-23T12:27:26.203 ERROR:paramiko.transport:
2021-06-23T12:27:26.203 ERROR:paramiko.transport:Traceback (most recent call last):
2021-06-23T12:27:26.203 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-06-23T12:27:26.204 ERROR:paramiko.transport:    self._check_banner()
2021-06-23T12:27:26.204 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-06-23T12:27:26.204 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-06-23T12:27:26.205 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-06-23T12:27:26.205 ERROR:paramiko.transport:
2021-06-23T12:27:32.261 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:33.316 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:34.411 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:35.467 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:36.563 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:37.660 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:38.756 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:39.851 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:40.951 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:41.954 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-06-23T12:27:41.955 ERROR:paramiko.transport:Traceback (most recent call last):
2021-06-23T12:27:41.956 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-06-23T12:27:41.957 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-06-23T12:27:41.957 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-06-23T12:27:41.958 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-06-23T12:27:41.959 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-06-23T12:27:41.959 ERROR:paramiko.transport:    raise EOFError()
2021-06-23T12:27:41.960 ERROR:paramiko.transport:EOFError
2021-06-23T12:27:41.960 ERROR:paramiko.transport:
2021-06-23T12:27:41.961 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-06-23T12:27:41.961 ERROR:paramiko.transport:
2021-06-23T12:27:41.962 ERROR:paramiko.transport:Traceback (most recent call last):
2021-06-23T12:27:41.963 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-06-23T12:27:41.963 ERROR:paramiko.transport:    self._check_banner()
2021-06-23T12:27:41.964 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-06-23T12:27:41.964 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-06-23T12:27:41.965 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-06-23T12:27:41.965 ERROR:paramiko.transport:
2021-06-23T12:27:48.061 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:49.154 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:50.157 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner
2021-06-23T12:27:50.158 ERROR:paramiko.transport:Traceback (most recent call last):
2021-06-23T12:27:50.158 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner
2021-06-23T12:27:50.159 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2021-06-23T12:27:50.159 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline
2021-06-23T12:27:50.159 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2021-06-23T12:27:50.160 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout
2021-06-23T12:27:50.160 ERROR:paramiko.transport:    raise EOFError()
2021-06-23T12:27:50.160 ERROR:paramiko.transport:EOFError
2021-06-23T12:27:50.161 ERROR:paramiko.transport:
2021-06-23T12:27:50.161 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2021-06-23T12:27:50.161 ERROR:paramiko.transport:
2021-06-23T12:27:50.162 ERROR:paramiko.transport:Traceback (most recent call last):
2021-06-23T12:27:50.162 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run
2021-06-23T12:27:50.162 ERROR:paramiko.transport:    self._check_banner()
2021-06-23T12:27:50.163 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner
2021-06-23T12:27:50.163 ERROR:paramiko.transport:    "Error reading SSH protocol banner" + str(e)
2021-06-23T12:27:50.163 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2021-06-23T12:27:50.164 ERROR:paramiko.transport:
2021-06-23T12:27:56.259 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:56.726 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-23T12:27:56.858 INFO:teuthology.provision.fog.gibba016:Node is ready
2021-06-23T12:27:56.910 INFO:teuthology.orchestra.run.gibba016.stdout:gibba016
2021-06-23T12:27:56.961 INFO:teuthology.orchestra.run.gibba016.stdout:172.21.2.116 gibba016 gibba016
2021-06-23T12:27:57.259 INFO:teuthology.provision.fog.gibba016:Deploy complete!
2021-06-23T12:27:57.354 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:27:58.451 ERROR:teuthology.orchestra.connection:Error authenticating with gibba041.front.sepia.ceph.com: Authentication failed.
2021-06-23T12:30:19.169 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-06-23T12:30:19.439 INFO:teuthology.provision.fog.gibba041:Node is ready
2021-06-23T12:30:19.491 INFO:teuthology.orchestra.run.gibba041.stdout:gibba041.front.sepia.ceph.com
2021-06-23T12:30:19.544 INFO:teuthology.orchestra.run.gibba041.stdout:172.21.2.141 gibba041.front.sepia.ceph.com gibba041
2021-06-23T12:30:19.834 INFO:teuthology.provision.fog.gibba041:Deploy complete!
2021-06-23T12:30:28.949 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 163, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 318, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 285, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1103, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan gibba016.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds
2021-06-23T12:30:29.004 INFO:teuthology.nuke:Checking targets against current locks
2021-06-23T12:30:29.094 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-23T12:30:29.097 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-06-23T12:30:29.156 INFO:teuthology.orchestra.console:Power off gibba041
2021-06-23T12:30:29.179 INFO:teuthology.orchestra.console:Power off gibba016
2021-06-23T12:30:29.337 INFO:teuthology.orchestra.console:Power off for gibba016 completed
2021-06-23T12:30:29.500 INFO:teuthology.lock.ops:unlocked gibba016.front.sepia.ceph.com
2021-06-23T12:30:37.556 INFO:teuthology.orchestra.console:Power off for gibba041 completed
2021-06-23T12:30:37.713 INFO:teuthology.lock.ops:unlocked gibba041.front.sepia.ceph.com
2021-06-23T12:30:37.714 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 50, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/dispatcher/supervisor.py", line 163, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 318, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/lock/ops.py", line 285, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/misc.py", line 1103, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_f359b10daba6e0103d42ccfc021bc797f3cd7edc/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan gibba016.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds