2023-07-15T07:17:44.769 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T07:17:44.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:17:44.772 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:17:44.940 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f00a8a148b0>, signals=[15]) 2023-07-15T07:17:44.942 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-07-15T07:17:44.942 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:17:44.943 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-07-15T07:17:44.965 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2023-07-15T07:17:44.965 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:17:44.966 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-07-15T07:17:44.967 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-07-15T07:17:48.365 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"} 2023-07-15T07:18:03.429 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-15T07:18:13.478 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-15T07:18:18.487 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-15T07:18:18.488 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 6} 2023-07-15T07:18:23.554 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of ubuntu 22.04 2023-07-15T07:18:23.554 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-15T07:18:28.529 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-15T07:18:28.530 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 6} 2023-07-15T07:18:28.623 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:18:33.582 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of ubuntu 22.04 2023-07-15T07:18:33.582 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-15T07:18:33.660 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-07-15T07:18:38.670 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:18:43.716 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1} 2023-07-15T07:18:48.722 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-15T07:18:53.730 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-15T07:19:08.856 INFO:teuthology.orchestra.console:Power off smithi031 2023-07-15T07:19:08.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:19:08.879 INFO:teuthology.orchestra.console:Power off smithi116 2023-07-15T07:19:08.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:19:08.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:08.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:13.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:13.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:19.021 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:19.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:24.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:24.155 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:29.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:29.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:34.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:34.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:39.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:39.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:39.700 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2023-07-15T07:19:39.801 INFO:teuthology.orchestra.console:Power on smithi031 2023-07-15T07:19:39.801 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:19:39.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:44.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:44.820 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-07-15T07:19:44.838 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:44.923 INFO:teuthology.orchestra.console:Power on smithi116 2023-07-15T07:19:44.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:19:44.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:49.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:49.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:55.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:19:55.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:00.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:00.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:05.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:05.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:10.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:10.430 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:10.643 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2023-07-15T07:20:10.744 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-07-15T07:20:10.745 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-15T07:20:14.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:17.392 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-07-15T07:20:18.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:23.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:20:23.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:28.503 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2023-07-15T07:20:28.606 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2023-07-15T07:20:28.607 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None 2023-07-15T07:20:33.613 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-07-15T07:20:33.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:39.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:44.621 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-15T07:20:50.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:20:53.680 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-15T07:20:59.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:03.088 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-07-15T07:21:09.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:09.210 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:21:09.212 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:21:09.212 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:21:09.213 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:10.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:11.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:12.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:13.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:14.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:15.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:16.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:17.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:18.192 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-07-15T07:21:18.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:19.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:20.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:21.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:22.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:23.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:24.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:21:29.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:29.270 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:21:29.270 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:21:29.271 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:21:29.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:30.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:30.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:31.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:31.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:32.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:32.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:33.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:33.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:34.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:34.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:35.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:35.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:36.274 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:36.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:37.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:37.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:38.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:38.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:39.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:39.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:40.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:40.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:41.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:41.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:42.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:42.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:43.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:43.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:44.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:44.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:45.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:45.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:46.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:46.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:47.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:47.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:48.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:48.494 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:49.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:49.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:50.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:50.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:51.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:51.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:52.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:52.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:53.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:53.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:54.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:54.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:55.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:55.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:56.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:56.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:57.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:57.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:58.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:58.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:59.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:21:59.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:00.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:00.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:01.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:01.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:02.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:02.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:03.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:03.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:04.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:04.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:05.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:05.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:06.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:06.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:07.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:07.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:08.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:08.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:09.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:09.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:10.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:10.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:11.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:11.761 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:12.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:12.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:13.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:13.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:14.688 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:14.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:15.696 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:15.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:16.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:16.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:17.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:17.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:18.721 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:18.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:19.732 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:19.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:20.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:20.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:21.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:21.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:22.761 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:22.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:23.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:23.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:24.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:24.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:25.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:25.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:26.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:26.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:27.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:27.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:28.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:28.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:29.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:29.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:30.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:30.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:31.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:31.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:32.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:32.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:33.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:33.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:34.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:35.002 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:35.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:36.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:36.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:37.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:37.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:38.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:38.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:39.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:39.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:40.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:40.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:41.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:41.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:42.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:42.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:43.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:44.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:44.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:45.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:45.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:46.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:46.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:47.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:47.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:48.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:48.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:49.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:49.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:50.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:50.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:51.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:51.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:52.089 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:52.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:53.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:53.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:54.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:54.210 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:55.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:55.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:56.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:56.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:57.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:57.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:58.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:58.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:59.164 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:22:59.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:00.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:00.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:01.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:01.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:02.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:02.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:03.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:03.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:04.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:04.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:05.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:05.318 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:06.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:06.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:07.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:07.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:08.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:08.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:09.100 ERROR:teuthology.provision.fog: on smithi031 2023-07-15T07:23:09.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:10.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:11.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:12.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:13.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:14.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:15.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:16.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:17.435 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:18.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-07-15T07:23:18.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:23:18.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:19.031 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:23:19.032 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-07-15T07:23:19.033 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:19.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:20.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:21.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:22.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:24.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:25.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:26.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:27.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:28.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:29.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:23:29.201 ERROR:teuthology.provision.fog: on smithi116 2023-07-15T07:23:38.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-15T07:23:38.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:23:43.318 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:23:43.319 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-07-15T07:23:43.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:25:52.213 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-15T07:25:52.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:25:52.326 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:25:52.326 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-07-15T07:25:52.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:04.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-15T07:28:04.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:28:09.296 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:28:09.297 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-07-15T07:28:09.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:12.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-07-15T07:30:12.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:30:12.314 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:30:12.314 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-07-15T07:30:12.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:32:12.251 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-15T07:32:12.253 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi116 2023-07-15T07:32:12.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:32:12.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:32:14.201 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T07:32:14.250 DEBUG:teuthology.nuke:shortname: smithi031 2023-07-15T07:32:14.251 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:32:14.272 DEBUG:teuthology.nuke:shortname: smithi116 2023-07-15T07:32:14.272 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:32:14.275 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:17:35.241836', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-15T07:32:14.298 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338711', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:17:35.243598', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-15T07:32:14.322 INFO:teuthology.orchestra.console:Power off smithi031 2023-07-15T07:32:14.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:32:14.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:14.362 INFO:teuthology.orchestra.console:Power off smithi116 2023-07-15T07:32:14.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:32:14.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:18.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:18.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:23.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:23.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:23.697 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2023-07-15T07:32:28.622 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-07-15T07:32:32.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:37.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:42.774 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:47.885 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:52.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:32:58.107 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:33:03.217 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:33:08.329 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:33:08.541 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2023-07-15T07:33:15.417 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2023-07-15T07:33:25.693 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi116