2023-07-25T20:35:54.820 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-25T20:35:54.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T20:35:54.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T20:36:19.535 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3d0d4f33a0>, signals=[15]) 2023-07-25T20:36:19.537 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2023-07-25T20:36:19.537 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T20:36:19.538 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-07-25T20:36:19.573 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-07-25T20:36:19.573 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T20:36:19.573 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-07-25T20:36:19.575 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /host {"name": "smithi142"} 2023-07-25T20:36:25.089 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-07-25T20:36:35.151 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-25T20:36:35.154 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-25T20:36:35.193 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-25T20:36:35.194 DEBUG:teuthology.provision.fog.smithi142:FOG request: PUT /host/247 {"imageID": 2} 2023-07-25T20:36:35.196 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-25T20:36:35.196 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 2} 2023-07-25T20:36:35.241 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2023-07-25T20:36:35.241 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:36:35.247 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 20.04 2023-07-25T20:36:35.247 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-25T20:36:35.345 DEBUG:teuthology.provision.fog.smithi163:Canceling deploy task with ID 409710 2023-07-25T20:36:35.345 DEBUG:teuthology.provision.fog.smithi163:FOG request: DELETE /task/cancel {"id": 409710} 2023-07-25T20:36:40.350 DEBUG:teuthology.provision.fog.smithi142:Canceling deploy task with ID 409708 2023-07-25T20:36:40.350 DEBUG:teuthology.provision.fog.smithi142:FOG request: DELETE /task/cancel {"id": 409708} 2023-07-25T20:36:45.398 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T20:36:50.401 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T20:36:54.161 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-07-25T20:36:54.178 DEBUG:teuthology.provision.fog.smithi142:FOG request: POST /host/247/task {"taskTypeID": 1} 2023-07-25T20:36:54.275 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:36:54.284 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-25T20:37:01.733 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-25T20:37:01.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:37:01.748 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-25T20:37:01.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:37:01.759 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:37:01.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:01.790 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:37:05.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:06.901 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:10.816 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:37:10.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:10.839 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:37:10.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:12.011 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:14.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:15.951 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:16.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:17.124 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:19.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:21.064 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:21.125 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:21.236 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:37:21.337 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-25T20:37:21.438 INFO:teuthology.orchestra.console:Power on smithi142 2023-07-25T20:37:21.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T20:37:21.460 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T20:37:21.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:21.483 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:37:25.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:25.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:26.180 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:26.595 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:30.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:30.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:31.292 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:31.707 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:35.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:35.709 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:36.404 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:36.820 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:40.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:40.821 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:41.516 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:41.931 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:45.520 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:45.932 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:46.632 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:47.044 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:50.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:51.046 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:51.750 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:52.158 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:55.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:56.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:56.864 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:57.270 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:00.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:01.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:01.979 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:02.383 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:05.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:06.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:06.495 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:38:06.596 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2023-07-25T20:38:06.697 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2023-07-25T20:38:06.698 DEBUG:teuthology.provision.fog.smithi142:FOG request: GET /task/active None 2023-07-25T20:38:11.707 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:38:11.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:11.809 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2023-07-25T20:38:11.909 INFO:teuthology.orchestra.console:Power on smithi163 2023-07-25T20:38:11.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T20:38:11.933 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T20:38:11.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:11.955 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:38:14.872 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-25T20:38:15.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:16.070 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:38:20.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:20.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:25.882 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:28.944 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-07-25T20:38:29.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:30.993 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:34.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:39.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:41.063 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:45.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:46.176 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:50.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:51.291 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:38:55.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:38:56.403 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:39:00.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:39:01.517 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:39:05.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:39:06.629 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:39:10.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:39:11.591 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:39:11.593 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T20:39:11.594 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T20:39:11.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:11.744 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:39:12.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:13.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:14.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:15.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:15.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:39:16.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:16.857 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:39:17.638 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:18.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:19.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:20.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:20.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:39:21.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:21.969 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:39:22.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:23.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:24.693 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:25.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:25.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:39:26.083 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:39:26.198 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2023-07-25T20:39:26.300 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-07-25T20:39:26.300 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:39:27.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:28.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:29.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:30.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:31.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:32.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:33.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:34.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:35.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:36.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:37.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:38.142 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:39.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:40.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:41.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:42.150 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:39:42.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:43.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:44.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:45.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:46.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:47.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:48.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:49.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:50.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:51.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:52.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:53.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:54.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:55.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:56.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:39:57.208 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:40:02.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:02.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:40:07.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:08.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:09.274 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:10.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:10.324 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:40:11.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:12.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:13.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:14.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:15.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:16.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:16.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:40:16.496 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:40:17.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:18.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:19.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:20.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:21.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:22.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:22.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:40:22.611 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:40:22.612 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T20:40:22.612 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T20:40:22.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:23.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:23.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:24.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:24.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:25.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:25.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:26.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:26.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:27.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:27.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:28.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:28.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:29.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:29.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:30.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:30.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:31.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:31.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:32.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:32.710 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:33.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:33.719 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:34.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:34.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:35.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:35.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:36.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:36.747 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:37.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:37.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:38.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:38.768 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:39.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:39.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:40.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:40.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:41.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:41.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:42.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:42.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:43.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:43.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:44.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:44.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:45.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:45.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:46.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:46.838 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:47.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:47.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:48.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:48.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:49.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:49.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:50.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:50.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:51.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:51.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:52.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:52.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:53.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:53.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:54.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:54.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:55.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:55.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:56.669 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:56.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:57.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:57.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:58.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:58.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:59.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:59.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:00.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:00.967 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:01.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:01.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:02.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:02.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:03.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:03.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:04.743 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:05.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:05.753 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:06.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:06.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:07.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:07.772 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:08.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:08.782 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:09.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:09.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:10.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:10.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:11.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:11.479 ERROR:teuthology.provision.fog: on smithi142 2023-07-25T20:41:12.072 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:13.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:14.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:15.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:16.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:17.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:18.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:19.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:20.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:20.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-07-25T20:41:20.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:41:20.598 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:41:20.599 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-07-25T20:41:20.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:21.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:22.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:23.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:24.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:25.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:26.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:27.173 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:28.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:29.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:30.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:31.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:32.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:33.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:34.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:35.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:36.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:37.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:38.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:39.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:40.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:41.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:42.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:43.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:44.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:45.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:46.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:47.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:48.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:49.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:50.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:51.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:52.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:53.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:54.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:55.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:56.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:57.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:58.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:59.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:00.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:01.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:02.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:03.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:04.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:05.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:06.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:07.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:08.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:09.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:10.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:11.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:12.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:13.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:14.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:15.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:16.587 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:17.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:18.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:19.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:20.618 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:21.627 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:22.505 ERROR:teuthology.provision.fog: on smithi163 2023-07-25T20:42:31.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:42:31.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:42:31.623 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:42:31.624 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:42:31.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:44:40.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:44:40.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:44:40.631 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:44:40.632 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:44:40.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:46:52.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:46:52.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:46:52.641 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:46:52.641 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:46:52.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:48:55.532 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:48:55.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:48:55.650 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:48:55.650 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:48:55.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:50:55.540 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-25T20:50:55.542 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi163 2023-07-25T20:50:55.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T20:50:55.544 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T20:51:00.653 INFO:teuthology.nuke:Checking targets against current locks 2023-07-25T20:51:10.692 DEBUG:teuthology.nuke:shortname: smithi142 2023-07-25T20:51:10.692 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T20:51:10.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 20:35:48.919547', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbUzVuLvOGHgXjUJBHwKtraRz1xBVvYYoN0e0mgk1keDBr4xwNmjAFi+SwOq+0qPpL01pSyKQNtWLVCfrlIuyhavJ/CEhKyg4F4MgHy1tQhry6xjRgR6TazuI58YvJYr2glV+vluRVv/OFUJUyU2dezEedpoX8boXgL8flZMhwjB0bACwgOzsXyWwithWrGXrWnveNK7dxqmG/5NGYhR3HJkyo3D88ZaTTCbsYLY7nB9bVEopliIUUykqU5QluMwRrHC//q3yxtzJueTX3ZJUxQObPFeVWZmFhmUeLTlaAzhJZsXYRBSuVY/0aQZ1/TCWsVHF/1rwXIKT5uhpqLqATP7OmJ+K7u4NpI16OJwhoeNGdXoJ5rUtNk4jwd3EDFPEwbx4eu3kSiKLrv8Ql1RGBprFOn5wsq+YlFBp2Qrj5gGD654gLmc6utGANGbyiWUsaxKKQ3f0SXK7W1DVPUf6y7nQ2HTvBBnfuo5Z33o5w4SJODtSMX8IXZ8Bl/XNfJ/U='} 2023-07-25T20:51:10.735 DEBUG:teuthology.nuke:shortname: smithi163 2023-07-25T20:51:10.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T20:51:10.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 20:35:48.917883', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrs5B89Hq4y/7WVbKUeVSVDKjOhnYggWuBmgbeQ/xzJ+hTQP6h1quOAlSrnU3gCQ6qXISWYLehv7j6ucxILAy/CzhPd85Rl7nKhF4bip4qNfBb5pxXWL2esRabReop2wXY6pNGq2JQPMjIrBQ7HPxQj2n37rGfpHbHm4kcgl9HDVhtrUzqzVHQyEMNxiLLI9y0jIKoeUoya3YeYAOC9t0pYERdE2szqmkBalJ20PEzwIQh7sTEIR0UMR8+CP5z2wxZbcjw75D9Tpzr+5K1HkMhiip+aMcH7wEj/f696uSKykQbgYo2QHUewKN479AOZLat4HlZ097pNjS8HiWkvkciqlcCE6YO36DJqqI640s7nqa2AmMv/SCES279rvewTFumtgoCc7so4AyQX/B7dD9R5xOahfVz8ilSaMX2qFScO4UsW5F/qdl1t/pPbQe81hfQOV70Xx3WXA1P2mIDMKGxCr35k07msIYUiq64On72WM9yPmkzUv543p4Nf4taoPM='} 2023-07-25T20:51:10.764 INFO:teuthology.orchestra.console:Power off smithi142 2023-07-25T20:51:10.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:51:10.786 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:51:10.787 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:10.809 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:51:10.822 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-25T20:51:10.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:51:10.847 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:51:10.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:10.870 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:51:14.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:14.871 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:15.921 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:15.981 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:19.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:19.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:21.033 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:21.094 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:25.035 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:25.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:25.206 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:51:25.308 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2023-07-25T20:51:30.418 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:51:35.444 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2023-07-25T20:51:35.459 ERROR:teuthology.lock.ops:failed to unlock smithi163.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node 2023-07-25T20:51:45.313 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com 2023-07-25T20:51:51.467 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi163