2023-07-15T19:47:56.547 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T19:47:56.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T19:47:56.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T19:47:56.671 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f95bf2218b0>, signals=[15]) 2023-07-15T19:47:56.673 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-07-15T19:47:56.673 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T19:47:56.673 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-07-15T19:47:56.698 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"} 2023-07-15T19:48:13.051 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-15T19:48:18.101 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-15T19:48:18.102 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 2} 2023-07-15T19:48:23.166 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of ubuntu 20.04 2023-07-15T19:48:23.167 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-07-15T19:48:28.248 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T19:48:33.292 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1} 2023-07-15T19:48:38.357 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-07-15T19:48:48.462 INFO:teuthology.orchestra.console:Power off smithi007 2023-07-15T19:48:48.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T19:48:53.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:48:58.500 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:03.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:08.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:13.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:18.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:24.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:29.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:34.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:39.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:44.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:49.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:54.729 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:49:54.941 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2023-07-15T19:49:55.043 INFO:teuthology.orchestra.console:Power on smithi007 2023-07-15T19:49:55.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T19:50:10.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:14.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:18.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:23.323 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:28.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:33.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:38.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:50:38.869 INFO:teuthology.orchestra.console:Power on for smithi007 completed 2023-07-15T19:50:38.971 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-07-15T19:50:38.971 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-07-15T19:50:44.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T19:50:52.144 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-07-15T19:50:58.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T19:51:06.224 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-07-15T19:51:12.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T19:51:48.967 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: Authentication failed. 2023-07-15T19:51:48.969 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T19:51:48.972 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T19:51:48.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:49.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:50.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:51.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:52.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:54.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:55.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:56.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:57.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:58.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:51:59.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:00.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:01.042 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:02.048 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:03.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:04.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:05.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:06.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:07.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:08.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:09.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:10.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:11.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:12.107 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:13.113 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:14.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:15.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:16.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:17.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:18.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:19.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:20.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:21.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:22.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:23.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:24.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:25.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:26.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:27.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:28.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:29.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:30.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:31.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:32.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:33.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:34.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:35.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:36.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:37.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:38.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:39.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:40.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:41.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:42.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:43.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:44.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:45.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:46.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:47.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:48.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:49.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:50.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:51.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:52.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:53.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:54.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:55.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:56.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:57.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:58.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:52:59.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:00.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:01.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:02.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:03.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:04.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:05.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:06.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:07.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:08.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:09.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:10.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:11.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:12.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:13.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:14.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:15.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:16.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:17.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:18.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:19.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:20.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:21.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:22.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:23.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:24.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:25.524 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:26.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:27.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:28.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:29.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:30.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:31.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:32.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:33.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:34.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:35.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:36.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:37.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:38.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:39.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:40.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:41.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:42.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:43.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:44.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:45.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:46.646 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:47.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:48.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:53:48.853 ERROR:teuthology.provision.fog: on smithi007 2023-07-15T19:53:57.862 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-07-15T19:53:57.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T19:54:02.982 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: Authentication failed. 2023-07-15T19:54:02.983 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-07-15T19:54:02.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:56:11.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-07-15T19:56:11.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T19:56:17.014 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: Authentication failed. 2023-07-15T19:56:17.015 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-07-15T19:56:17.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T19:58:28.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-07-15T19:58:28.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T19:58:34.024 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: Authentication failed. 2023-07-15T19:58:34.024 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-07-15T19:58:34.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T20:00:36.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-07-15T20:00:36.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T20:00:42.041 ERROR:teuthology.orchestra.connection:Error authenticating with smithi007.front.sepia.ceph.com: Authentication failed. 2023-07-15T20:00:42.042 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-07-15T20:00:42.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T20:02:41.930 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-15T20:02:41.932 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi007 2023-07-15T20:02:41.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T20:02:41.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T20:02:47.023 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T20:02:57.090 DEBUG:teuthology.nuke:shortname: smithi007 2023-07-15T20:02:57.091 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T20:03:02.124 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:46:34-rados-reef-distro-default-smithi/7339399', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 19:47:55.718418', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD1nIMeRuB2+bI4wDqsF093BMhZFMk3UWj/xPZhFIG4seOFkuIpNso5EIXhQSUiMeEMx2fLTarkex8WodJvDGPpKKtME4ET+LuiuZpRdngSU1RjWc+s1VCp55Uq1Ppb6eLGm+O41CE1h6/LU9JcGm90UqHqZ3vmjvsTSCHv6wHJ/3YyTaJqUytccsjv9r5U4+0p5fClx+G+NtoV544T18lIUpOAv9MHtOvyItplSf0Glw5ht5xgyTXM1WclIUy4eKRLaC2iIHDw6NedTVRsgamMlZAIrePLZSNgsdHulHekTOBnA/uF4Gm2mQVYYBwfkzzTSkzy/I0nGFfGNVVzFvVagyWe0VbLOR6rh//TbtChxFT9YWVzSJGL1Ain7qQpx+uNkq+xKK0Tv3i/2C8fGPzMB+zYCs+L9TaIUQbAMDrscKPepiHh4I01pLBUPLqQXlGrlYIPSTANJjUjtphlhhILzlRnMIKN2X1JQF3Z7ovVxB7raSUorRvnbm+yJC0LkyE='} 2023-07-15T20:03:12.193 INFO:teuthology.orchestra.console:Power off smithi007 2023-07-15T20:03:12.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T20:03:17.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:22.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:27.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:32.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:37.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:42.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:47.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:52.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T20:03:53.112 INFO:teuthology.orchestra.console:Power off for smithi007 completed 2023-07-15T20:04:03.282 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-07-15T20:04:03.579 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi007