2021-04-12T02:33:21.163 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-12T02:33:21.391 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging 2021-04-12T02:33:21.392 INFO:teuthology.lock.ops:Updating [ubuntu@smithi100.front.sepia.ceph.com]: reset os type and version on server 2021-04-12T02:33:21.392 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2021-04-12T02:33:21.408 INFO:teuthology.lock.ops:Node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging is complete 2021-04-12T02:33:21.408 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi178.front.sepia.ceph.com' reimaging 2021-04-12T02:33:21.409 INFO:teuthology.lock.ops:Updating [ubuntu@smithi178.front.sepia.ceph.com]: reset os type and version on server 2021-04-12T02:33:21.409 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2021-04-12T02:33:21.423 INFO:teuthology.lock.ops:Node 'ubuntu@smithi178.front.sepia.ceph.com' reimaging is complete 2021-04-12T02:33:22.599 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 18.04 2021-04-12T02:33:22.728 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 18.04 2021-04-12T02:33:26.956 INFO:teuthology.orchestra.console:Power off smithi100 2021-04-12T02:33:27.095 INFO:teuthology.orchestra.console:Power off for smithi100 completed 2021-04-12T02:33:27.196 INFO:teuthology.orchestra.console:Power on smithi100 2021-04-12T02:33:27.870 INFO:teuthology.orchestra.console:Power off smithi178 2021-04-12T02:33:35.556 INFO:teuthology.orchestra.console:Power on for smithi100 completed 2021-04-12T02:33:35.657 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2021-04-12T02:33:36.231 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2021-04-12T02:33:36.332 INFO:teuthology.orchestra.console:Power on smithi178 2021-04-12T02:33:44.752 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2021-04-12T02:33:44.853 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2021-04-12T02:38:13.166 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:14.266 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:15.365 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:16.462 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:17.560 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:18.666 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:19.762 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:20.859 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:21.956 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:23.053 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:29.056 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:38:29.057 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:38:29.058 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:38:29.058 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:38:29.059 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:38:29.059 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:38:29.059 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:38:29.060 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:38:29.060 ERROR:paramiko.transport:EOFError 2021-04-12T02:38:29.060 ERROR:paramiko.transport: 2021-04-12T02:38:29.061 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:38:29.061 ERROR:paramiko.transport: 2021-04-12T02:38:29.062 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:38:29.062 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:38:29.063 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:38:29.063 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:38:29.063 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:38:29.064 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:38:29.064 ERROR:paramiko.transport: 2021-04-12T02:38:35.161 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:36.265 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:37.268 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:38:37.269 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:38:37.269 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:38:37.270 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:38:37.270 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:38:37.270 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:38:37.270 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:38:37.271 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:38:37.271 ERROR:paramiko.transport:EOFError 2021-04-12T02:38:37.271 ERROR:paramiko.transport: 2021-04-12T02:38:37.272 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:38:37.272 ERROR:paramiko.transport: 2021-04-12T02:38:37.272 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:38:37.273 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:38:37.273 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:38:37.274 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:38:37.274 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:38:37.274 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:38:37.274 ERROR:paramiko.transport: 2021-04-12T02:38:43.374 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:44.470 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:45.567 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:46.664 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:47.761 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:48.858 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:49.964 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:51.061 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:52.159 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:53.256 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:38:59.259 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:38:59.259 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:38:59.260 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:38:59.260 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:38:59.260 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:38:59.261 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:38:59.261 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:38:59.261 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:38:59.262 ERROR:paramiko.transport:EOFError 2021-04-12T02:38:59.262 ERROR:paramiko.transport: 2021-04-12T02:38:59.263 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:38:59.263 ERROR:paramiko.transport: 2021-04-12T02:38:59.264 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:38:59.264 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:38:59.265 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:38:59.265 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:38:59.265 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:38:59.266 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:38:59.266 ERROR:paramiko.transport: 2021-04-12T02:39:05.269 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:05.269 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:05.270 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:05.270 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:05.270 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:05.271 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:05.271 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:05.271 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:05.271 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:05.272 ERROR:paramiko.transport: 2021-04-12T02:39:05.272 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:05.272 ERROR:paramiko.transport: 2021-04-12T02:39:05.273 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:05.273 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:05.273 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:05.274 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:05.274 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:05.274 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:05.275 ERROR:paramiko.transport: 2021-04-12T02:39:11.372 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:12.469 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:13.473 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:13.475 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:13.475 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:13.476 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:13.477 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:13.478 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:13.478 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:13.479 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:13.479 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:13.480 ERROR:paramiko.transport: 2021-04-12T02:39:13.481 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:13.481 ERROR:paramiko.transport: 2021-04-12T02:39:13.482 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:13.482 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:13.483 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:13.483 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:13.484 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:13.485 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:13.485 ERROR:paramiko.transport: 2021-04-12T02:39:19.586 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:20.708 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:21.711 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:21.711 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:21.712 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:21.712 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:21.712 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:21.713 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:21.713 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:21.713 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:21.714 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:21.714 ERROR:paramiko.transport: 2021-04-12T02:39:21.715 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:21.715 ERROR:paramiko.transport: 2021-04-12T02:39:21.716 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:21.716 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:21.717 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:21.717 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:21.718 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:21.719 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:21.719 ERROR:paramiko.transport: 2021-04-12T02:39:27.817 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:28.820 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:28.821 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:28.822 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:28.822 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:28.823 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:28.823 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:28.824 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:28.825 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:28.825 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:28.826 ERROR:paramiko.transport: 2021-04-12T02:39:28.826 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:28.827 ERROR:paramiko.transport: 2021-04-12T02:39:28.828 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:28.828 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:28.829 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:28.830 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:28.830 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:28.831 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:28.831 ERROR:paramiko.transport: 2021-04-12T02:39:34.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:35.892 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:35.893 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:35.893 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:35.894 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:35.894 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:35.894 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:35.895 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:35.895 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:35.895 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:35.895 ERROR:paramiko.transport: 2021-04-12T02:39:35.896 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:35.896 ERROR:paramiko.transport: 2021-04-12T02:39:35.896 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:35.897 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:35.897 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:35.897 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:35.898 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:35.898 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:35.898 ERROR:paramiko.transport: 2021-04-12T02:39:41.901 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:41.902 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:41.902 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:41.902 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:41.903 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:41.903 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:41.904 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:41.904 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:41.904 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:41.905 ERROR:paramiko.transport: 2021-04-12T02:39:41.905 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:41.905 ERROR:paramiko.transport: 2021-04-12T02:39:41.906 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:41.906 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:41.907 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:41.907 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:41.907 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:41.908 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:41.908 ERROR:paramiko.transport: 2021-04-12T02:39:48.005 ERROR:teuthology.orchestra.connection:Error authenticating with smithi100.front.sepia.ceph.com: Authentication failed. 2021-04-12T02:39:49.008 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:49.009 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:49.009 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:49.009 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:49.010 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:49.010 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:49.011 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:49.011 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:49.011 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:49.012 ERROR:paramiko.transport: 2021-04-12T02:39:49.012 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:49.012 ERROR:paramiko.transport: 2021-04-12T02:39:49.012 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:49.013 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:49.013 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:49.013 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:49.014 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:49.014 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:49.014 ERROR:paramiko.transport: 2021-04-12T02:39:55.017 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:39:55.018 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:55.018 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:39:55.019 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:39:55.019 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:39:55.019 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:39:55.021 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:39:55.021 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:39:55.022 ERROR:paramiko.transport:EOFError 2021-04-12T02:39:55.022 ERROR:paramiko.transport: 2021-04-12T02:39:55.022 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:39:55.023 ERROR:paramiko.transport: 2021-04-12T02:39:55.023 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:39:55.023 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:39:55.024 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:39:55.024 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:39:55.024 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:39:55.025 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:39:55.025 ERROR:paramiko.transport: 2021-04-12T02:40:01.030 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:40:01.031 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:40:01.031 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:40:01.031 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:40:01.032 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:40:01.032 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:40:01.032 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:40:01.033 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:40:01.033 ERROR:paramiko.transport:EOFError 2021-04-12T02:40:01.033 ERROR:paramiko.transport: 2021-04-12T02:40:01.033 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:40:01.034 ERROR:paramiko.transport: 2021-04-12T02:40:01.034 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:40:01.035 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:40:01.035 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:40:01.035 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:40:01.036 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:40:01.036 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:40:01.037 ERROR:paramiko.transport: 2021-04-12T02:40:07.040 ERROR:paramiko.transport:Exception: Error reading SSH protocol banner 2021-04-12T02:40:07.041 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:40:07.042 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2211, in _check_banner 2021-04-12T02:40:07.043 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2021-04-12T02:40:07.043 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 380, in readline 2021-04-12T02:40:07.045 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2021-04-12T02:40:07.046 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/packet.py", line 609, in _read_timeout 2021-04-12T02:40:07.046 ERROR:paramiko.transport: raise EOFError() 2021-04-12T02:40:07.047 ERROR:paramiko.transport:EOFError 2021-04-12T02:40:07.047 ERROR:paramiko.transport: 2021-04-12T02:40:07.048 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2021-04-12T02:40:07.048 ERROR:paramiko.transport: 2021-04-12T02:40:07.049 ERROR:paramiko.transport:Traceback (most recent call last): 2021-04-12T02:40:07.049 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2039, in run 2021-04-12T02:40:07.050 ERROR:paramiko.transport: self._check_banner() 2021-04-12T02:40:07.050 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 2216, in _check_banner 2021-04-12T02:40:07.051 ERROR:paramiko.transport: "Error reading SSH protocol banner" + str(e) 2021-04-12T02:40:07.051 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2021-04-12T02:40:07.052 ERROR:paramiko.transport: 2021-04-12T02:41:50.498 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-12T02:42:05.597 INFO:teuthology.provision.fog.smithi100:Node is ready 2021-04-12T02:42:05.615 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2021-04-12T02:42:05.672 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2021-04-12T02:42:06.020 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2021-04-12T02:49:38.236 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/lock/ops.py", line 317, in reimage_machines log.info("Node '%s' reimaging is complete", machine) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/provision/__init__.py", line 39, in reimage return obj.create() File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/provision/fog.py", line 86, in create self.wait_for_deploy_task(task_id) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/provision/fog.py", line 244, in wait_for_deploy_task while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 900 seconds 2021-04-12T02:49:38.290 INFO:teuthology.nuke:Checking targets against current locks 2021-04-12T02:49:38.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-12T02:49:38.510 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-04-12T02:49:38.535 ERROR:teuthology.nuke:Could not nuke {'ubuntu@smithi100.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDhP9Hlkz2Rx8BTZQtTozpC9358boWP9bxNELCmJ9DQqCl4NS6OLPpgNHZsVl9w4fXWeloaQd2Qk/u2b7d6RMvW5jYAL06dXMAlFYQIpe8kflUIFeuwln+jUcHIa3S+iJ4Z/5RjgcUnZW1icG8q8fsu1ScJBl5YUmitOCF9Unwa9pF2ZE8aAvDYxdYRbjphB8A2diMQg10hRnlLggCKtKvyeuj7Tigia8vCxcOzwcXV0mWlh1+RbnTuUhiOSQilYuU6oWzBvJ03IDPG0SclzsNxuvgIOmC/YSeg0woajLOGufy9JtpNpKrmv87HF/okfHaw2AR8e1P8gfdkqcpnhWjb'} Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/nuke/__init__.py", line 292, in nuke_one nuke_helper(ctx, should_unlock, keep_logs, should_reboot) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/nuke/__init__.py", line 315, in nuke_helper check_lock.check_lock(ctx, None, check_up=False) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/task/internal/check_lock.py", line 29, in check_lock 'machine {name} is not locked'.format(name=machine) AssertionError: machine ubuntu@smithi100.front.sepia.ceph.com is not locked 2021-04-12T02:49:38.547 ERROR:teuthology.nuke:Could not nuke {'ubuntu@smithi178.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX675LDxEvfxuPsHDmrKEmXGR1YhIxaTRaraY64YmDq/JyZo4d2yWbBsDfNuL1Nij4tZqz4ICzqipjOrjzkV86LtGG95V1kaBH8NviDRMVdMnS9nA241FXzZQIr+97BndrCgGnnaj9aErGVkLYIikqX2+14B5PEKQ9s9l5mF/r0PX1FTQQg1cI+ggK+xMLwO01hwtNMEfWIQPOcIVC6gnTy2CeBc/5Hb+WLchN5tyaMVRV/AUbDN5KUiC79Dex3LVET3I4fCK5kVs92K1BxY0Gi6NK5GqRYCjk8Fp95jEqLt8mMbzKQeq0F2kK8dkz3S+ycRH3lK/DRrj79MlXYSUJAsKmj2C3UW2XwQyr9v6EBzOVXZuocbj/6HblSdcImr/qCJsj7DgRY64+Q4A+TIY1ng1aY7VGVtNfNmyX5R6ZSBHUtdbMGPYBxzhhogfkr9Luruuhh0UeZ4k0eYo4R7rHh8XWq9XSQq1zgVSGr9xh1nzpwhbadf+hA24Hg9EPbfc='} Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/nuke/__init__.py", line 292, in nuke_one nuke_helper(ctx, should_unlock, keep_logs, should_reboot) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/nuke/__init__.py", line 315, in nuke_helper check_lock.check_lock(ctx, None, check_up=False) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/task/internal/check_lock.py", line 29, in check_lock 'machine {name} is not locked'.format(name=machine) AssertionError: machine ubuntu@smithi178.front.sepia.ceph.com is not locked 2021-04-12T02:49:38.550 ERROR:teuthology.nuke:Could not nuke the following targets: targets: ubuntu@smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDhP9Hlkz2Rx8BTZQtTozpC9358boWP9bxNELCmJ9DQqCl4NS6OLPpgNHZsVl9w4fXWeloaQd2Qk/u2b7d6RMvW5jYAL06dXMAlFYQIpe8kflUIFeuwln+jUcHIa3S+iJ4Z/5RjgcUnZW1icG8q8fsu1ScJBl5YUmitOCF9Unwa9pF2ZE8aAvDYxdYRbjphB8A2diMQg10hRnlLggCKtKvyeuj7Tigia8vCxcOzwcXV0mWlh1+RbnTuUhiOSQilYuU6oWzBvJ03IDPG0SclzsNxuvgIOmC/YSeg0woajLOGufy9JtpNpKrmv87HF/okfHaw2AR8e1P8gfdkqcpnhWjb ubuntu@smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDX675LDxEvfxuPsHDmrKEmXGR1YhIxaTRaraY64YmDq/JyZo4d2yWbBsDfNuL1Nij4tZqz4ICzqipjOrjzkV86LtGG95V1kaBH8NviDRMVdMnS9nA241FXzZQIr+97BndrCgGnnaj9aErGVkLYIikqX2+14B5PEKQ9s9l5mF/r0PX1FTQQg1cI+ggK+xMLwO01hwtNMEfWIQPOcIVC6gnTy2CeBc/5Hb+WLchN5tyaMVRV/AUbDN5KUiC79Dex3LVET3I4fCK5kVs92K1BxY0Gi6NK5GqRYCjk8Fp95jEqLt8mMbzKQeq0F2kK8dkz3S+ycRH3lK/DRrj79MlXYSUJAsKmj2C3UW2XwQyr9v6EBzOVXZuocbj/6HblSdcImr/qCJsj7DgRY64+Q4A+TIY1ng1aY7VGVtNfNmyX5R6ZSBHUtdbMGPYBxzhhogfkr9Luruuhh0UeZ4k0eYo4R7rHh8XWq9XSQq1zgVSGr9xh1nzpwhbadf+hA24Hg9EPbfc= 2021-04-12T02:49:38.551 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/supervisor.py", line 50, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/lock/ops.py", line 317, in reimage_machines log.info("Node '%s' reimaging is complete", machine) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/provision/__init__.py", line 39, in reimage return obj.create() File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/provision/fog.py", line 86, in create self.wait_for_deploy_task(task_id) File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/provision/fog.py", line 244, in wait_for_deploy_task while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 900 seconds