2023-07-11T08:47:18.470 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T08:47:18.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T08:47:18.472 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T08:47:33.222 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97e0ebbca0>, signals=[15]) 2023-07-11T08:47:33.224 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-07-11T08:47:33.224 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T08:47:33.225 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-07-11T08:47:48.262 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-07-11T08:47:48.262 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T08:47:48.262 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-07-11T08:47:48.264 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-07-11T08:47:58.311 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-07-11T08:48:04.782 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T08:48:07.274 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-11T08:48:07.293 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T08:48:07.293 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 3} 2023-07-11T08:48:07.313 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3) 2023-07-11T08:48:07.314 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3} 2023-07-11T08:48:07.333 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream 2023-07-11T08:48:07.334 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T08:48:07.352 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream 2023-07-11T08:48:07.352 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T08:48:07.403 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T08:48:07.417 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T08:48:07.437 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-07-11T08:48:07.455 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-07-11T08:48:07.586 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T08:48:12.589 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T08:48:24.419 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-11T08:48:24.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:48:24.435 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-11T08:48:24.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T08:48:24.445 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:24.457 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:24.568 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-11T08:48:24.578 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-11T08:48:24.670 INFO:teuthology.orchestra.console:Power on smithi142 2023-07-11T08:48:24.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T08:48:24.680 INFO:teuthology.orchestra.console:Power on smithi203 2023-07-11T08:48:24.681 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T08:48:29.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:29.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:34.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:34.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:39.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:39.829 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:44.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:44.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:50.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:50.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:55.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:48:55.170 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:00.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:00.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:05.389 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:05.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:10.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:10.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:10.714 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2023-07-11T08:49:10.815 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-07-11T08:49:10.815 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-11T08:49:14.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:49:18.004 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-11T08:49:18.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:23.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T08:49:24.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:49:29.121 INFO:teuthology.orchestra.console:Power on for smithi203 completed 2023-07-11T08:49:29.222 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-07-11T08:49:29.222 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-07-11T08:49:34.229 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-11T08:49:34.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:49:40.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:49:45.237 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T08:49:51.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:50:03.760 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-11T08:50:09.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:50:14.772 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-07-11T08:50:14.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:50:14.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:50:14.893 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:50:14.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:15.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:16.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:17.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:18.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:19.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:20.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:50:20.892 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:50:20.892 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:50:20.893 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:50:20.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:20.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:21.902 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:21.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:22.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:22.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:23.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:23.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:24.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:24.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:25.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:25.988 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:26.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:26.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:27.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:28.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:28.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:29.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:29.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:30.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:30.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:31.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:32.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:32.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:33.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:33.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:34.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:34.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:35.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:35.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:36.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:36.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:37.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:37.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:38.070 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:38.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:39.079 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:39.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:40.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:40.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:41.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:41.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:42.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:42.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:43.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:43.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:44.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:44.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:45.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:45.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:46.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:46.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:47.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:47.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:48.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:48.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:49.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:49.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:50.184 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:50.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:51.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:51.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:52.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:52.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:53.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:53.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:54.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:54.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:55.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:55.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:56.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:56.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:57.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:57.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:58.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:58.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:59.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:50:59.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:00.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:00.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:01.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:01.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:02.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:02.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:03.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:03.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:04.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:04.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:05.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:05.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:06.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:06.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:07.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:07.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:08.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:08.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:09.351 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:09.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:10.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:10.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:11.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:11.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:12.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:12.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:13.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:13.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:14.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:14.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:15.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:15.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:16.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:16.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:17.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:17.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:18.422 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:18.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:19.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:19.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:20.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:20.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:21.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:21.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:22.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:22.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:23.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:23.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:24.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:24.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:25.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:25.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:26.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:26.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:27.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:27.607 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:28.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:28.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:29.524 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:29.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:30.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:30.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:31.540 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:31.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:32.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:32.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:33.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:33.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:34.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:34.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:35.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:35.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:36.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:36.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:37.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:37.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:38.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:38.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:39.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:39.707 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:40.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:40.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:41.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:41.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:42.628 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:42.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:43.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:43.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:44.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:44.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:45.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:45.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:46.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:46.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:47.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:47.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:48.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:48.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:49.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:49.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:50.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:50.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:51.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:51.798 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:52.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:52.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:53.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:53.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:54.719 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:54.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:55.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:55.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:56.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:56.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:57.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:57.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:58.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:58.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:59.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:51:59.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:00.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:00.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:01.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:01.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:02.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:02.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:03.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:03.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:04.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:04.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:05.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:05.902 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:06.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:07.817 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:08.827 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:09.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:10.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:11.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:12.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:13.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:14.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:15.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:16.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:17.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:18.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:19.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:52:20.778 ERROR:teuthology.provision.fog: on smithi203 2023-07-11T08:52:29.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-11T08:52:29.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:52:29.907 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:52:29.907 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-11T08:52:29.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:54:20.529 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-11T08:54:20.530 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi142 2023-07-11T08:54:29.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-07-11T08:54:29.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:54:34.787 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-07-11T08:54:35.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-07-11T08:54:35.064 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T08:54:35.064 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T08:54:35.084 INFO:teuthology.provision.fog.smithi142:Node is ready 2023-07-11T08:54:35.084 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2023-07-11T08:54:35.144 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2023-07-11T08:54:35.145 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2023-07-11T08:54:35.204 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2023-07-11T08:54:35.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-07-11T08:54:35.321 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2023-07-11T08:54:35.354 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2023-07-11T08:54:35.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2023-07-11T08:54:35.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2023-07-11T08:54:35.561 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-07-11T08:54:35.619 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2023-07-11T08:54:35.620 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2023-07-11T08:54:35.620 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2023-07-11T08:54:35.620 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2023-07-11T08:54:35.620 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-11T08:54:35.621 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-11T08:54:35.622 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-11T08:54:35.622 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2023-07-11T08:54:35.624 DEBUG:teuthology.parallel:result is None 2023-07-11T08:54:43.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-11T08:54:43.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:54:48.622 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:54:48.623 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-11T08:54:48.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:57:00.549 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-11T08:57:00.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:57:05.670 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:57:05.670 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-11T08:57:05.671 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T08:59:08.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-07-11T08:59:08.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T08:59:13.681 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: Authentication failed. 2023-07-11T08:59:13.682 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-07-11T08:59:13.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T09:01:13.568 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-11T09:01:13.570 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi203 2023-07-11T09:01:13.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T09:01:13.571 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T09:01:18.657 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T09:01:23.723 DEBUG:teuthology.nuke:shortname: smithi142 2023-07-11T09:01:23.724 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T09:01:23.750 DEBUG:teuthology.nuke:shortname: smithi203 2023-07-11T09:01:23.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T09:01:23.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:47:17.569568', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-11T09:01:23.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/prsrivas-2023-07-11_08:35:15-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7333599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:47:17.567266', 'locked_by': 'scheduled_prsrivas@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-11T09:01:28.807 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-11T09:01:28.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T09:01:28.831 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:28.850 INFO:teuthology.orchestra.console:Power off smithi203 2023-07-11T09:01:28.850 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T09:01:28.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:32.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:32.900 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:37.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:37.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:38.184 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-11T09:01:43.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T09:01:48.367 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2023-07-11T09:01:48.438 INFO:teuthology.orchestra.console:Power off for smithi203 completed 2023-07-11T09:01:49.450 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com 2023-07-11T09:01:49.536 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi203 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/requests/models.py", line 910, in json return complexjson.loads(self.text, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/simplejson/__init__.py", line 525, in loads return _default_decoder.decode(s) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/simplejson/decoder.py", line 370, in decode obj, end = self.raw_decode(s) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/simplejson/decoder.py", line 400, in raw_decode return self.scan_once(s, idx=_w(s, idx).end()) simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 237, in reimage check_for_reimage_failures_and_mark_down(targets) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 198, in check_for_reimage_failures_and_mark_down jobs = resp.json() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/requests/models.py", line 917, in json raise RequestsJSONDecodeError(e.msg, e.doc, e.pos) requests.exceptions.JSONDecodeError: [Errno Expecting value] Internal Server Error

Internal Server Error

: 0