2023-06-27T00:11:52.763 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-27T00:11:52.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:11:52.765 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:11:58.149 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff28ed278b0>, signals=[15]) 2023-06-27T00:11:58.151 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-06-27T00:11:58.152 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T00:11:58.152 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-06-27T00:11:58.181 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-06-27T00:11:58.182 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-06-27T00:11:58.182 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-06-27T00:11:58.185 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-06-27T00:12:03.221 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"} 2023-06-27T00:12:06.479 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-27T00:12:06.516 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-27T00:12:06.524 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-27T00:12:06.525 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 2} 2023-06-27T00:12:06.556 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-27T00:12:06.557 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 2} 2023-06-27T00:12:06.569 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of ubuntu 20.04 2023-06-27T00:12:06.569 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:12:16.578 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of ubuntu 20.04 2023-06-27T00:12:16.578 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-27T00:12:21.641 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T00:12:26.649 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"} 2023-06-27T00:12:30.538 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-06-27T00:12:30.541 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1} 2023-06-27T00:12:30.602 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:12:30.615 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-27T00:12:35.707 INFO:teuthology.orchestra.console:Power off smithi002 2023-06-27T00:12:35.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:12:35.726 INFO:teuthology.orchestra.console:Power off smithi043 2023-06-27T00:12:35.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:12:35.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:35.753 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:35.865 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-06-27T00:12:35.877 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-06-27T00:12:35.967 INFO:teuthology.orchestra.console:Power on smithi002 2023-06-27T00:12:35.967 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T00:12:35.979 INFO:teuthology.orchestra.console:Power on smithi043 2023-06-27T00:12:35.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-27T00:12:35.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:36.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:40.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:40.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:40.235 INFO:teuthology.orchestra.console:Power on for smithi043 completed 2023-06-27T00:12:40.336 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-06-27T00:12:40.337 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-06-27T00:12:45.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:12:45.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:12:45.558 INFO:teuthology.orchestra.console:Power on for smithi002 completed 2023-06-27T00:12:45.659 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-06-27T00:12:45.659 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:12:50.667 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-27T00:12:56.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:13:04.752 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-27T00:13:05.731 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:13:10.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:13:18.832 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-27T00:13:24.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:13:30.767 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:13:35.773 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-27T00:13:41.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:13:50.836 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:14:05.172 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-27T00:14:07.516 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:14:12.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:14:17.600 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:18.714 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:19.787 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:25.867 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:31.942 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:32.591 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:14:38.014 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:44.092 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:46.453 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:47.527 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:47.672 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:14:49.859 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:14:49.860 WARNING:teuthology.provision.fog.smithi043:'connect to smithi043.front.sepia.ceph.com' reached maximum tries (11) after waiting for 10 seconds 2023-06-27T00:14:55.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:15:00.866 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-27T00:15:00.868 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:00.868 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-27T00:15:00.869 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-27T00:15:00.869 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-27T00:15:00.869 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-27T00:15:00.870 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-27T00:15:00.870 ERROR:paramiko.transport: raise EOFError() 2023-06-27T00:15:00.870 ERROR:paramiko.transport:EOFError 2023-06-27T00:15:00.871 ERROR:paramiko.transport: 2023-06-27T00:15:00.871 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-27T00:15:00.872 ERROR:paramiko.transport: 2023-06-27T00:15:00.872 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:00.872 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-27T00:15:00.872 ERROR:paramiko.transport: self._check_banner() 2023-06-27T00:15:00.873 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-27T00:15:00.873 ERROR:paramiko.transport: raise SSHException( 2023-06-27T00:15:00.873 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-27T00:15:00.873 ERROR:paramiko.transport: 2023-06-27T00:15:00.873 WARNING:teuthology.provision.fog.smithi043:Error reading SSH protocol banner 2023-06-27T00:15:04.817 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:15:09.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:15:09.894 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:15:15.975 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:15:17.048 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:15:18.051 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-27T00:15:18.052 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:18.052 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-27T00:15:18.052 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-27T00:15:18.052 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-27T00:15:18.053 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-27T00:15:18.053 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-27T00:15:18.053 ERROR:paramiko.transport: raise EOFError() 2023-06-27T00:15:18.053 ERROR:paramiko.transport:EOFError 2023-06-27T00:15:18.053 ERROR:paramiko.transport: 2023-06-27T00:15:18.054 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-27T00:15:18.054 ERROR:paramiko.transport: 2023-06-27T00:15:18.054 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:18.054 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-27T00:15:18.054 ERROR:paramiko.transport: self._check_banner() 2023-06-27T00:15:18.055 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-27T00:15:18.055 ERROR:paramiko.transport: raise SSHException( 2023-06-27T00:15:18.055 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-27T00:15:18.055 ERROR:paramiko.transport: 2023-06-27T00:15:18.056 WARNING:teuthology.provision.fog.smithi043:Error reading SSH protocol banner 2023-06-27T00:15:24.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:15:24.060 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-27T00:15:24.061 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:24.061 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-27T00:15:24.062 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-27T00:15:24.062 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-27T00:15:24.062 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-27T00:15:24.063 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-27T00:15:24.063 ERROR:paramiko.transport: raise EOFError() 2023-06-27T00:15:24.064 ERROR:paramiko.transport:EOFError 2023-06-27T00:15:24.064 ERROR:paramiko.transport: 2023-06-27T00:15:24.065 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-27T00:15:24.065 ERROR:paramiko.transport: 2023-06-27T00:15:24.066 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:24.066 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-27T00:15:24.067 ERROR:paramiko.transport: self._check_banner() 2023-06-27T00:15:24.067 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-27T00:15:24.068 ERROR:paramiko.transport: raise SSHException( 2023-06-27T00:15:24.068 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-27T00:15:24.068 ERROR:paramiko.transport: 2023-06-27T00:15:24.069 WARNING:teuthology.provision.fog.smithi043:Error reading SSH protocol banner 2023-06-27T00:15:24.882 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:15:30.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:15:35.078 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-27T00:15:35.078 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:35.079 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-27T00:15:35.079 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-27T00:15:35.080 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-27T00:15:35.080 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-27T00:15:35.081 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-27T00:15:35.081 ERROR:paramiko.transport: raise EOFError() 2023-06-27T00:15:35.082 ERROR:paramiko.transport:EOFError 2023-06-27T00:15:35.082 ERROR:paramiko.transport: 2023-06-27T00:15:35.083 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-27T00:15:35.083 ERROR:paramiko.transport: 2023-06-27T00:15:35.083 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:35.083 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-27T00:15:35.084 ERROR:paramiko.transport: self._check_banner() 2023-06-27T00:15:35.084 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-27T00:15:35.084 ERROR:paramiko.transport: raise SSHException( 2023-06-27T00:15:35.084 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-27T00:15:35.084 ERROR:paramiko.transport: 2023-06-27T00:15:35.085 WARNING:teuthology.provision.fog.smithi043:Error reading SSH protocol banner 2023-06-27T00:15:41.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:15:46.089 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:15:51.097 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner 2023-06-27T00:15:51.098 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:51.098 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner 2023-06-27T00:15:51.098 ERROR:paramiko.transport: buf = self.packetizer.readline(timeout) 2023-06-27T00:15:51.098 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline 2023-06-27T00:15:51.099 ERROR:paramiko.transport: buf += self._read_timeout(timeout) 2023-06-27T00:15:51.099 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout 2023-06-27T00:15:51.099 ERROR:paramiko.transport: raise EOFError() 2023-06-27T00:15:51.099 ERROR:paramiko.transport:EOFError 2023-06-27T00:15:51.099 ERROR:paramiko.transport: 2023-06-27T00:15:51.100 ERROR:paramiko.transport:During handling of the above exception, another exception occurred: 2023-06-27T00:15:51.100 ERROR:paramiko.transport: 2023-06-27T00:15:51.100 ERROR:paramiko.transport:Traceback (most recent call last): 2023-06-27T00:15:51.100 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run 2023-06-27T00:15:51.100 ERROR:paramiko.transport: self._check_banner() 2023-06-27T00:15:51.101 ERROR:paramiko.transport: File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner 2023-06-27T00:15:51.101 ERROR:paramiko.transport: raise SSHException( 2023-06-27T00:15:51.101 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner 2023-06-27T00:15:51.101 ERROR:paramiko.transport: 2023-06-27T00:15:51.101 WARNING:teuthology.provision.fog.smithi043:Error reading SSH protocol banner 2023-06-27T00:15:57.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:16:02.180 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:16:03.291 ERROR:teuthology.orchestra.connection:Error authenticating with smithi043.front.sepia.ceph.com: Authentication failed. 2023-06-27T00:16:09.297 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-06-27T00:16:14.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:16:22.452 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-06-27T00:16:28.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:16:31.504 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-06-27T00:16:37.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:16:45.584 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-06-27T00:16:51.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:16:54.640 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-06-27T00:17:00.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:17:03.700 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-06-27T00:17:09.298 WARNING:teuthology.provision.fog.smithi043:timed out 2023-06-27T00:17:09.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:17:15.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:17:38.672 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-06-27T00:17:44.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:17:50.534 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T00:17:50.536 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T00:17:51.018 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-06-27T00:17:51.018 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-06-27T00:17:51.025 INFO:teuthology.orchestra.run.smithi043.stdout:smithi129 2023-06-27T00:17:51.025 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi129 /etc/hosts 2023-06-27T00:17:51.032 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.129 smithi129 smithi129 2023-06-27T00:17:51.032 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-06-27T00:17:51.156 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi129/smithi043/g' /etc/hosts 2023-06-27T00:17:51.174 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.129/172.21.15.43/g' /etc/hosts 2023-06-27T00:17:51.192 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi129/smithi043/g' /etc/hostname 2023-06-27T00:17:51.206 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-06-27T00:17:51.265 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-06-27T00:17:51.269 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu" 2023-06-27T00:17:51.269 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:17:51.269 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu 2023-06-27T00:17:51.269 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian 2023-06-27T00:17:51.269 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="20.04" 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=focal 2023-06-27T00:17:51.270 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:17:51.271 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-06-27T00:17:51.273 DEBUG:teuthology.parallel:result is None 2023-06-27T00:18:09.704 WARNING:teuthology.provision.fog.smithi002:timed out 2023-06-27T00:18:15.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:18:15.916 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-27T00:18:15.917 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-27T00:18:16.422 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-06-27T00:18:16.423 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-06-27T00:18:16.429 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-06-27T00:18:16.429 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-06-27T00:18:16.480 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-06-27T00:18:16.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-06-27T00:18:16.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-06-27T00:18:16.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-06-27T00:18:16.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-06-27T00:18:16.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-06-27T00:18:16.716 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-06-27T00:18:16.720 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="20.04" 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:18:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:18:16.722 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:18:16.722 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:18:16.722 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=focal 2023-06-27T00:18:16.722 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:18:16.722 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-06-27T00:18:16.723 DEBUG:teuthology.parallel:result is None 2023-06-27T00:18:21.994 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-06-27T00:18:21.995 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-27T00:18:25.525 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-06-27T00:18:25.525 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-27T00:18:30.559 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-06-27T00:18:30.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-06-27T00:18:30.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:18:30.611 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-06-27T00:18:30.813 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-06-27T00:18:30.819 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-06-27T00:18:30.819 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-06-27T00:18:30.825 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-06-27T00:18:30.825 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:18:30.825 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-06-27T00:18:30.825 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="20.04" 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:18:30.826 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=focal 2023-06-27T00:18:30.827 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:18:30.827 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-06-27T00:18:35.857 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-06-27T00:18:35.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-06-27T00:18:35.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-27T00:18:40.907 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-06-27T00:18:41.109 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-06-27T00:18:41.115 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-06-27T00:18:41.115 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-06-27T00:18:41.121 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu" 2023-06-27T00:18:41.121 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="20.04" 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-27T00:18:41.122 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-27T00:18:41.123 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-27T00:18:41.123 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=focal 2023-06-27T00:18:41.123 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=focal 2023-06-27T00:18:41.123 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-06-27T00:18:44.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:18:44.481 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:18:44.581 INFO:teuthology.dispatcher.supervisor:Running job 7317183 2023-06-27T00:18:44.582 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317183 --name yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/osd 2-workunit/suites/iozone}} -- /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317183/orig.config.yaml 2023-06-27T00:18:44.585 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317183 2023-06-27T00:18:44.586 INFO:teuthology.dispatcher.supervisor:Job PID: 16603 2023-06-27T00:18:44.586 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-27T00:20:44.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:20:44.589 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:22:47.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:22:47.079 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:24:52.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:24:52.151 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:26:54.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:26:54.384 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:28:59.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:28:59.467 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:31:04.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:31:04.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:33:09.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:33:09.630 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:35:10.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:35:10.836 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:37:15.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:37:15.920 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:39:20.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:39:20.569 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:41:25.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:41:25.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:43:28.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:43:28.675 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:45:33.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-27T00:45:33.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-27T00:45:33.831 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-27T00:45:33.952 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-27T00:45:33.952 INFO:teuthology.nuke:Checking targets against current locks 2023-06-27T00:45:34.011 DEBUG:teuthology.nuke:shortname: smithi002 2023-06-27T00:45:34.012 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T00:45:34.040 DEBUG:teuthology.nuke:shortname: smithi043 2023-06-27T00:45:34.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-27T00:45:34.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317183', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 00:11:39.693696', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-27T00:45:34.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-26_19:12:21-fs-wip-yuri4-testing-2023-06-26-0711-quincy-distro-default-smithi/7317183', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-27 00:11:39.691839', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-27T00:45:34.101 INFO:teuthology.orchestra.console:Power off smithi002 2023-06-27T00:45:34.102 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:45:34.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:45:34.146 INFO:teuthology.orchestra.console:Power off smithi043 2023-06-27T00:45:34.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-27T00:45:34.259 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-06-27T00:45:44.444 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-06-27T00:45:49.178 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-27T00:45:49.301 INFO:teuthology.orchestra.console:Power off for smithi043 completed 2023-06-27T00:45:49.469 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com