2023-06-22T03:16:31.108 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T03:16:31.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T03:16:31.110 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T03:16:31.234 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1d6db828b0>, signals=[15]) 2023-06-22T03:16:31.235 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-06-22T03:16:31.236 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-06-22T03:16:31.236 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-06-22T03:16:31.266 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-06-22T03:16:46.639 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-22T03:16:51.694 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-22T03:16:51.694 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 6} 2023-06-22T03:16:56.744 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 22.04 2023-06-22T03:16:56.744 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-06-22T03:16:58.241 DEBUG:teuthology.provision.fog.smithi060:Canceling deploy task with ID 335104 2023-06-22T03:16:58.241 DEBUG:teuthology.provision.fog.smithi060:FOG request: DELETE /task/cancel {"id": 335104} 2023-06-22T03:16:58.281 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-06-22T03:16:58.315 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-06-22T03:16:58.362 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-06-22T03:17:06.289 INFO:teuthology.orchestra.console:Power off smithi060 2023-06-22T03:17:06.290 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T03:17:06.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T03:17:06.434 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-06-22T03:17:06.535 INFO:teuthology.orchestra.console:Power on smithi060 2023-06-22T03:17:06.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-22T03:17:06.557 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T03:17:10.580 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T03:17:15.691 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T03:17:20.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T03:17:21.014 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2023-06-22T03:17:21.115 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-06-22T03:17:21.115 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-06-22T03:17:26.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:17:29.296 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:17:35.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:17:43.376 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:17:49.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:17:53.584 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:17:59.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:18:02.640 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:18:08.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:18:40.355 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:18:41.472 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:18:47.594 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:18:53.676 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:18:54.757 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:18:55.873 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:18:56.999 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:03.010 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:19:03.011 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:19:03.012 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:19:03.013 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:19:03.013 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:19:03.013 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:19:03.013 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:19:03.013 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:19:03.014 ERROR:paramiko.transport:EOFError 2023-06-22T03:19:03.014 ERROR:paramiko.transport: 2023-06-22T03:19:03.014 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:19:03.014 ERROR:paramiko.transport: 2023-06-22T03:19:03.014 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:19:03.015 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:19:03.015 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:19:03.015 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:19:03.015 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:19:03.016 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:19:03.016 ERROR:paramiko.transport: 2023-06-22T03:19:03.016 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:19:09.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:19:14.096 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:15.215 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:21.301 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:22.418 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:28.425 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:19:28.426 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:19:28.426 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:19:28.427 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:19:28.427 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:19:28.427 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:19:28.427 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:19:28.427 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:19:28.428 ERROR:paramiko.transport:EOFError 2023-06-22T03:19:28.428 ERROR:paramiko.transport: 2023-06-22T03:19:28.428 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:19:28.428 ERROR:paramiko.transport: 2023-06-22T03:19:28.428 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:19:28.429 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:19:28.429 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:19:28.429 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:19:28.430 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:19:28.430 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:19:28.430 ERROR:paramiko.transport: 2023-06-22T03:19:28.430 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:19:34.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:19:39.551 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:45.673 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:19:49.498 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:19:49.499 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:19:49.499 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:19:49.499 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:19:49.500 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:19:49.500 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:19:49.500 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:19:49.500 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:19:49.501 ERROR:paramiko.transport:EOFError 2023-06-22T03:19:49.501 ERROR:paramiko.transport: 2023-06-22T03:19:49.501 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:19:49.501 ERROR:paramiko.transport: 2023-06-22T03:19:49.502 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:19:49.502 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:19:49.502 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:19:49.502 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:19:49.503 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:19:49.503 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:19:49.504 ERROR:paramiko.transport: 2023-06-22T03:19:49.504 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:19:55.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:20:00.633 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:20:03.112 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:20:04.115 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:20:04.116 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:04.117 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:20:04.118 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:20:04.118 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:20:04.118 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:20:04.119 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:20:04.120 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:20:04.120 ERROR:paramiko.transport:EOFError 2023-06-22T03:20:04.121 ERROR:paramiko.transport: 2023-06-22T03:20:04.121 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:20:04.122 ERROR:paramiko.transport: 2023-06-22T03:20:04.123 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:04.123 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:20:04.123 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:20:04.124 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:20:04.125 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:20:04.125 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:20:04.126 ERROR:paramiko.transport: 2023-06-22T03:20:04.126 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:20:10.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:20:12.353 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:20:18.358 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:20:18.359 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:18.359 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:20:18.359 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:20:18.360 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:20:18.360 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:20:18.360 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:20:18.360 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:20:18.360 ERROR:paramiko.transport:EOFError 2023-06-22T03:20:18.361 ERROR:paramiko.transport: 2023-06-22T03:20:18.361 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:20:18.361 ERROR:paramiko.transport: 2023-06-22T03:20:18.361 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:18.361 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:20:18.362 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:20:18.362 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:20:18.362 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:20:18.362 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:20:18.363 ERROR:paramiko.transport: 2023-06-22T03:20:18.363 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:20:24.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:20:28.537 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:20:28.537 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:28.537 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:20:28.538 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:20:28.538 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:20:28.538 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:20:28.538 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:20:28.538 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:20:28.539 ERROR:paramiko.transport:EOFError 2023-06-22T03:20:28.539 ERROR:paramiko.transport: 2023-06-22T03:20:28.539 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:20:28.539 ERROR:paramiko.transport: 2023-06-22T03:20:28.539 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:28.540 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:20:28.540 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:20:28.540 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:20:28.540 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:20:28.540 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:20:28.541 ERROR:paramiko.transport: 2023-06-22T03:20:28.541 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:20:34.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:20:34.545 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:20:34.546 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:34.546 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:20:34.546 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:20:34.546 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:20:34.547 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:20:34.547 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:20:34.547 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:20:34.547 ERROR:paramiko.transport:EOFError 2023-06-22T03:20:34.547 ERROR:paramiko.transport: 2023-06-22T03:20:34.548 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:20:34.548 ERROR:paramiko.transport: 2023-06-22T03:20:34.548 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:34.548 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:20:34.549 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:20:34.549 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:20:34.549 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:20:34.550 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:20:34.551 ERROR:paramiko.transport: 2023-06-22T03:20:34.551 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:20:40.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:20:41.924 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:20:41.924 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:41.925 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:20:41.926 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:20:41.926 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:20:41.926 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:20:41.926 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:20:41.926 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:20:41.927 ERROR:paramiko.transport:EOFError 2023-06-22T03:20:41.927 ERROR:paramiko.transport: 2023-06-22T03:20:41.927 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:20:41.927 ERROR:paramiko.transport: 2023-06-22T03:20:41.927 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:41.928 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:20:41.928 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:20:41.928 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:20:41.928 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:20:41.929 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:20:41.929 ERROR:paramiko.transport: 2023-06-22T03:20:41.929 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:20:47.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:20:53.051 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:20:59.054 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-22T03:20:59.055 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:59.055 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-22T03:20:59.055 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-22T03:20:59.055 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-22T03:20:59.056 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-22T03:20:59.056 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-22T03:20:59.056 ERROR:paramiko.transport: raise EOFError() 2023-06-22T03:20:59.056 ERROR:paramiko.transport:EOFError 2023-06-22T03:20:59.056 ERROR:paramiko.transport: 2023-06-22T03:20:59.057 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-22T03:20:59.057 ERROR:paramiko.transport: 2023-06-22T03:20:59.057 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-22T03:20:59.057 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-22T03:20:59.058 ERROR:paramiko.transport: self._check_banner() 2023-06-22T03:20:59.058 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-22T03:20:59.058 ERROR:paramiko.transport: raise SSHException( 2023-06-22T03:20:59.058 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-22T03:20:59.058 ERROR:paramiko.transport: 2023-06-22T03:20:59.059 WARNING:teuthology.provision.fog.smithi060:Error reading SSH protocol banner 2023-06-22T03:21:05.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:21:05.140 ERROR:teuthology.orchestra.connection:Error authenticating with smithi060.front.sepia.ceph.com: Authentication failed. 2023-06-22T03:21:45.840 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:21:51.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:22:56.846 WARNING:teuthology.provision.fog.smithi060:timed out 2023-06-22T03:23:02.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:23:07.853 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:23:13.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:23:14.080 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-22T03:23:14.081 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-22T03:23:14.549 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-06-22T03:23:14.549 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-06-22T03:23:14.596 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-06-22T03:23:14.597 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-06-22T03:23:14.648 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-06-22T03:23:14.648 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-06-22T03:23:14.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-06-22T03:23:14.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-06-22T03:23:14.847 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-06-22T03:23:14.905 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-06-22T03:23:14.961 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-06-22T03:23:15.008 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-22T03:23:15.009 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2023-06-22T03:23:15.009 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="22.04" 2023-06-22T03:23:15.010 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-22T03:23:15.010 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=jammy 2023-06-22T03:23:15.010 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2023-06-22T03:23:15.010 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2023-06-22T03:23:15.011 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-22T03:23:15.011 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-22T03:23:15.011 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-22T03:23:15.012 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-22T03:23:15.012 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=jammy 2023-06-22T03:23:15.013 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-06-22T03:23:15.014 DEBUG:teuthology.parallel:result is None 2023-06-22T03:23:45.161 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-06-22T03:23:45.162 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-22T03:23:50.200 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-06-22T03:23:50.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-06-22T03:23:50.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T03:24:29.680 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-06-22T03:24:29.682 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 327, in reimage_machines update_nodes(reimaged) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 38, in update_nodes inventory_info = remote.inventory_info File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 679, in inventory_info node['arch'] = self.arch File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 335, in arch self._arch = self.sh('uname -m').strip() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi060 2023-06-22T03:24:29.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T03:24:29.683 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-22T03:24:29.765 INFO:teuthology.nuke:Checking targets against current locks 2023-06-22T03:24:29.815 DEBUG:teuthology.nuke:shortname: smithi060 2023-06-22T03:24:29.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T03:24:29.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-06-21_22:15:54-rados-wip-rishabh-improvements-authmon-distro-default-smithi/7310847', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 03:24:29.520956', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKvk4wqT8KqmJHYwUq/84ZvpKsviCESz6tE/zy3BIu6OfN9YEmI4ZOZxrumUyuxeF/OEtEtV660pjwkQ7IeI3+4='} 2023-06-22T03:24:29.894 INFO:teuthology.orchestra.console:Power off smithi060 2023-06-22T03:24:29.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-22T03:24:29.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-22T03:24:30.064 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2023-06-22T03:24:40.213 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2023-06-22T03:24:45.378 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 327, in reimage_machines update_nodes(reimaged) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 38, in update_nodes inventory_info = remote.inventory_info File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 679, in inventory_info node['arch'] = self.arch File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 335, in arch self._arch = self.sh('uname -m').strip() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 524, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi060