2023-07-15T07:25:21.728 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T07:25:21.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:25:21.730 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:25:31.969 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd5e17988b0>, signals=[15]) 2023-07-15T07:25:31.971 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging 2023-07-15T07:25:31.971 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:25:31.971 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-07-15T07:25:31.995 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-07-15T07:25:31.995 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T07:25:31.996 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-07-15T07:25:31.998 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /host {"name": "smithi089"} 2023-07-15T07:25:37.027 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-07-15T07:25:51.392 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T07:26:01.407 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-15T07:26:03.513 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T07:26:03.513 DEBUG:teuthology.provision.fog.smithi089:FOG request: PUT /host/194 {"imageID": 3} 2023-07-15T07:26:03.572 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_8.stream (ID 3) 2023-07-15T07:26:03.573 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 3} 2023-07-15T07:26:03.577 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream 2023-07-15T07:26:03.578 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:26:03.626 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 8.stream 2023-07-15T07:26:03.626 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-15T07:26:03.654 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:26:03.692 DEBUG:teuthology.provision.fog.smithi089:FOG request: POST /host/194/task {"taskTypeID": 1} 2023-07-15T07:26:03.697 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T07:26:03.734 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-07-15T07:26:03.743 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:26:03.785 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-15T07:26:13.864 INFO:teuthology.orchestra.console:Power off smithi089 2023-07-15T07:26:13.865 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:26:13.882 INFO:teuthology.orchestra.console:Power off smithi097 2023-07-15T07:26:13.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:26:13.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:13.906 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:17.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:17.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:23.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:23.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:28.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:28.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:33.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:33.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:38.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:38.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:38.584 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-07-15T07:26:38.685 INFO:teuthology.orchestra.console:Power on smithi097 2023-07-15T07:26:38.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:26:43.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:43.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:47.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:48.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:52.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:53.701 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:57.960 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:26:58.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:03.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:03.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:08.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:08.398 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2023-07-15T07:27:08.499 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-07-15T07:27:08.500 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-15T07:27:11.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:11.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:27:19.952 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-15T07:27:21.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:25.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:27:30.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:34.032 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-15T07:27:36.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:37.188 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-07-15T07:27:37.189 ERROR:teuthology.orchestra.console:Failed to power off smithi089 2023-07-15T07:27:37.190 INFO:teuthology.orchestra.console:Power on smithi089 2023-07-15T07:27:37.190 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T07:27:40.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:27:46.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:48.112 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-15T07:27:50.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:27:54.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:27:59.121 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:28:04.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:28:09.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:28:09.558 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2023-07-15T07:28:09.659 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2023-07-15T07:28:09.660 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:28:17.520 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-15T07:28:23.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:28:25.353 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-15T07:28:27.232 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:28:31.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:28:36.474 ERROR:teuthology.orchestra.connection:Error authenticating with smithi097.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:28:36.476 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:28:36.476 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:28:36.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:37.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:38.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:39.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:40.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:41.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:42.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:43.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:44.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:44.957 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:28:47.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:48.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:49.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:50.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:51.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:52.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:53.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:54.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:55.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:56.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:57.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:58.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:28:59.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:00.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:01.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:02.316 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:29:02.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:03.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:04.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:05.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:06.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:07.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:08.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:09.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:10.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:11.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:12.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:13.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:14.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:15.422 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:16.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:17.390 DEBUG:teuthology.provision.fog.smithi089:FOG request: GET /task/active None 2023-07-15T07:29:22.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:22.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:29:27.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:27.842 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-07-15T07:29:28.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:29.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:30.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:31.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:32.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:33.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:33.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:29:38.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:38.921 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:29:38.921 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:29:38.921 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:29:38.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:39.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:39.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:40.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:40.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:41.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:41.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:42.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:42.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:43.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:43.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:44.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:44.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:45.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:45.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:46.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:46.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:47.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:48.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:48.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:49.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:49.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:50.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:50.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:51.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:51.967 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:52.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:52.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:53.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:53.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:54.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:54.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:55.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:56.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:56.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:57.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:57.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:58.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:58.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:59.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:29:59.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:00.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:00.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:01.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:01.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:02.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:02.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:03.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:03.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:04.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:04.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:05.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:05.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:06.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:06.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:07.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:07.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:08.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:08.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:09.113 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:09.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:10.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:10.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:11.132 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:11.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:12.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:12.214 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:13.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:13.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:14.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:14.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:15.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:15.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:16.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:16.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:17.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:17.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:18.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:18.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:19.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:19.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:20.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:20.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:21.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:21.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:22.236 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:22.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:23.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:23.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:24.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:25.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:26.347 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:27.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:28.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:29.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:30.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:31.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:32.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:33.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:34.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:35.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:36.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:37.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:38.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:39.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:40.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:41.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:42.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:43.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:44.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:45.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:46.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:47.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:48.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:49.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:50.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:51.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:52.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:53.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:54.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:55.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:56.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:57.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:58.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:30:59.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:00.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:01.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:02.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:03.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:04.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:05.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:06.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:07.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:08.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:09.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:10.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:11.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:12.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:13.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:14.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:15.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:16.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:17.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:18.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:19.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:20.851 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:21.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:22.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:23.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:24.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:25.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:26.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:27.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:28.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:29.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:30.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:31.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:32.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:33.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:34.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:35.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:36.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:38.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:31:38.853 ERROR:teuthology.provision.fog: on smithi089 2023-07-15T07:31:47.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-07-15T07:31:47.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:31:47.968 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:31:47.969 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-07-15T07:31:47.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:32:37.616 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-15T07:32:37.617 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi097 2023-07-15T07:32:46.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-07-15T07:32:46.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:32:46.851 DEBUG:teuthology.orchestra.run.smithi097:> true 2023-07-15T07:32:47.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2023-07-15T07:32:47.130 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T07:32:47.130 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T07:32:47.155 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-07-15T07:32:47.155 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-07-15T07:32:47.220 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2023-07-15T07:32:47.220 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts 2023-07-15T07:32:47.287 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-07-15T07:32:47.287 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-07-15T07:32:47.389 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts 2023-07-15T07:32:47.422 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-07-15T07:32:47.495 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname 2023-07-15T07:32:47.569 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-07-15T07:32:47.638 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-07-15T07:32:47.699 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream" 2023-07-15T07:32:47.699 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8" 2023-07-15T07:32:47.700 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos" 2023-07-15T07:32:47.700 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora" 2023-07-15T07:32:47.700 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8" 2023-07-15T07:32:47.700 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-07-15T07:32:47.700 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-15T07:32:47.700 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-07-15T07:32:47.701 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-15T07:32:47.701 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/" 2023-07-15T07:32:47.701 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T07:32:47.701 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T07:32:47.701 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-15T07:32:47.702 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-07-15T07:32:47.703 DEBUG:teuthology.parallel:result is None 2023-07-15T07:33:56.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-07-15T07:33:56.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:33:56.984 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:33:56.984 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-07-15T07:33:56.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:36:08.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-07-15T07:36:08.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:36:14.010 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:36:14.010 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-07-15T07:36:14.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:38:16.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-07-15T07:38:16.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T07:38:17.018 ERROR:teuthology.orchestra.connection:Error authenticating with smithi089.front.sepia.ceph.com: Authentication failed. 2023-07-15T07:38:17.019 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-07-15T07:38:17.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T07:40:16.909 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-15T07:40:16.911 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi089 2023-07-15T07:40:16.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T07:40:16.913 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T07:40:22.002 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T07:40:42.078 DEBUG:teuthology.nuke:shortname: smithi089 2023-07-15T07:40:42.078 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:40:42.116 DEBUG:teuthology.nuke:shortname: smithi097 2023-07-15T07:40:42.117 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T07:40:42.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338734', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:25:06.119087', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHnyAuLoJayJXnhsuAA1XReO0+NW1Ad+3lnVoOKShW4i'} 2023-07-15T07:40:42.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338734', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:25:06.116748', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBINB1DW0dVxRqrd8SrV2ck71pk7TOWHRkJCX973tfvLKbtSD1AotaqlUvJ4xM6adr3a7grUJjZeIoN7nCjU97Vw='} 2023-07-15T07:40:42.198 INFO:teuthology.orchestra.console:Power off smithi089 2023-07-15T07:40:42.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:40:42.216 INFO:teuthology.orchestra.console:Power off smithi097 2023-07-15T07:40:42.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T07:40:42.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:42.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:46.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:46.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:51.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:51.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:56.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:40:56.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:41:01.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:41:01.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:41:01.813 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-07-15T07:41:08.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:41:08.861 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-07-15T07:41:13.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:41:19.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T07:41:19.260 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2023-07-15T07:41:24.417 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2023-07-15T07:41:24.689 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi089