2023-07-25T20:34:49.278 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-25T20:34:49.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T20:34:49.281 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T20:34:49.440 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4154cab310>, signals=[15]) 2023-07-25T20:34:49.441 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-07-25T20:34:49.442 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T20:34:49.442 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-07-25T20:34:49.467 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-07-25T20:34:49.468 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T20:34:49.468 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-07-25T20:34:49.469 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-07-25T20:34:59.498 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-07-25T20:35:09.778 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-25T20:35:18.437 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-25T20:35:23.444 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-25T20:35:23.452 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 2} 2023-07-25T20:35:26.057 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of ubuntu 20.04 2023-07-25T20:35:26.058 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:35:26.061 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-25T20:35:26.061 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 2} 2023-07-25T20:35:26.125 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2023-07-25T20:35:26.125 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:35:26.158 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T20:35:26.211 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T20:35:26.220 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-07-25T20:35:26.261 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-07-25T20:35:26.331 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:35:26.380 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:35:26.484 INFO:teuthology.orchestra.console:Power off smithi105 2023-07-25T20:35:26.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:35:26.510 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:35:26.511 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:26.532 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-25T20:35:26.534 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:35:26.545 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:35:26.558 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:35:26.558 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:26.583 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:35:30.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:30.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:30.712 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:35:30.720 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:35:34.716 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:34.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:34.827 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:35:34.834 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:35:38.832 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:38.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:39.943 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:39.951 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:43.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:43.956 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:45.058 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:45.067 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:49.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:49.070 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:50.172 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:50.180 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:54.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:54.188 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:55.290 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:55.303 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:35:59.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:35:59.304 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:00.403 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:00.414 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:04.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:04.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:05.517 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:05.528 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:09.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:09.530 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:10.629 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:10.640 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:14.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:14.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:15.740 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:15.751 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:19.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:19.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:19.851 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:36:19.862 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:36:19.953 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-07-25T20:36:19.963 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2023-07-25T20:36:20.054 INFO:teuthology.orchestra.console:Power on smithi105 2023-07-25T20:36:20.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T20:36:20.065 INFO:teuthology.orchestra.console:Power on smithi163 2023-07-25T20:36:20.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T20:36:25.090 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T20:36:25.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:26.100 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:30.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:31.214 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:35.086 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T20:36:35.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:35.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:36.097 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:36.325 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:40.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:40.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:41.211 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:41.438 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:45.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:45.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:46.323 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:46.554 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:50.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:50.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:51.438 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:51.666 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:55.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:55.667 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:36:56.550 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:36:56.777 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:00.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:00.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:01.668 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:01.887 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:05.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:05.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:06.783 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:06.999 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:10.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:11.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:11.111 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:37:11.212 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2023-07-25T20:37:11.313 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-07-25T20:37:11.313 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-07-25T20:37:16.321 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:16.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:37:21.408 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:22.520 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:24.464 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:37:26.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:27.634 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:30.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:37:35.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:36.584 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:38.544 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:37:40.585 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:41.698 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:44.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:37:49.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:50.668 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:52.628 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:37:54.669 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:55.780 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:37:58.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:37:59.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:37:59.892 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:37:59.994 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2023-07-25T20:38:00.095 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-07-25T20:38:00.095 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:38:01.716 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:38:07.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:15.792 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:38:16.336 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:38:21.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:25.904 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:38:31.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:36.913 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:38:41.921 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:38:47.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:38:55.984 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:38:56.998 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:39:02.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:39:10.064 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:39:16.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:39:19.124 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:39:22.068 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:39:27.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:39:35.156 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:39:41.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:39:47.148 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:39:52.154 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:39:58.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:40:07.231 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-07-25T20:40:08.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:40:13.603 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:40:13.604 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T20:40:13.605 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T20:40:13.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:14.610 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:15.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:16.496 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-07-25T20:40:16.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:17.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:18.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:19.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:20.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:21.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:22.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:40:22.613 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:40:22.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T20:40:22.613 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T20:40:22.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:22.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:23.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:23.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:24.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:24.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:25.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:25.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:26.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:26.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:27.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:27.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:28.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:28.719 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:29.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:29.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:30.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:30.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:31.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:31.749 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:32.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:32.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:33.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:33.771 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:34.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:34.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:35.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:35.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:36.753 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:36.799 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:37.763 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:37.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:38.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:38.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:39.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:39.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:40.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:40.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:41.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:41.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:42.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:42.855 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:43.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:43.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:44.833 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:44.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:45.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:45.881 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:46.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:46.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:47.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:47.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:48.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:48.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:49.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:49.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:50.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:50.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:51.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:51.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:52.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:52.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:53.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:53.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:54.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:54.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:55.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:55.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:56.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:56.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:57.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:57.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:58.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:59.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:40:59.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:00.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:00.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:01.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:01.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:02.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:02.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:03.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:04.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:04.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:05.016 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:05.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:06.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:06.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:07.033 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:07.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:08.043 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:08.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:09.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:09.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:10.060 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:10.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:11.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:11.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:12.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:12.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:13.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:13.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:14.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:14.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:15.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:15.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:16.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:16.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:17.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:18.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:19.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:20.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:21.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:22.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:23.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:24.184 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:25.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:26.202 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:27.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:28.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:29.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:30.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:31.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:32.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:33.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:34.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:35.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:36.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:37.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:38.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:39.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:40.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:41.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:42.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:43.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:44.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:45.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:46.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:47.397 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:48.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:49.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:50.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:51.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:52.442 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:53.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:54.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:55.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:56.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:57.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:58.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:41:59.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:00.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:01.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:02.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:03.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:04.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:05.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:06.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:07.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:08.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:09.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:10.602 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:11.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:12.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:13.628 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:14.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:15.645 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:16.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:17.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:18.671 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:19.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:20.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:21.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:42:22.505 ERROR:teuthology.provision.fog: on smithi163 2023-07-25T20:42:31.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:42:31.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:42:31.621 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:42:31.622 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:42:31.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:43:05.201 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-25T20:43:05.202 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi105 2023-07-25T20:43:14.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-07-25T20:43:14.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:43:14.418 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-07-25T20:43:15.015 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-07-25T20:43:15.015 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T20:43:15.016 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T20:43:15.021 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-07-25T20:43:15.021 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-07-25T20:43:15.028 INFO:teuthology.orchestra.run.smithi105.stdout:smithi129 2023-07-25T20:43:15.029 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi129 /etc/hosts 2023-07-25T20:43:15.037 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.129 smithi129 smithi129 2023-07-25T20:43:15.037 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-07-25T20:43:15.151 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi129/smithi105/g' /etc/hosts 2023-07-25T20:43:15.169 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.129/172.21.15.105/g' /etc/hosts 2023-07-25T20:43:15.224 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi129/smithi105/g' /etc/hostname 2023-07-25T20:43:15.236 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-07-25T20:43:15.247 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-07-25T20:43:15.303 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="Ubuntu" 2023-07-25T20:43:15.303 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-25T20:43:15.303 INFO:teuthology.orchestra.run.smithi105.stdout:ID=ubuntu 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE=debian 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="20.04" 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-25T20:43:15.304 INFO:teuthology.orchestra.run.smithi105.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-25T20:43:15.305 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_CODENAME=focal 2023-07-25T20:43:15.305 INFO:teuthology.orchestra.run.smithi105.stdout:UBUNTU_CODENAME=focal 2023-07-25T20:43:15.305 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-07-25T20:43:15.306 DEBUG:teuthology.parallel:result is None 2023-07-25T20:44:40.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:44:40.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:44:40.631 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:44:40.632 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:44:40.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:46:52.524 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:46:52.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:46:52.639 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:46:52.640 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:46:52.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:48:55.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-07-25T20:48:55.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T20:48:55.614 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: Authentication failed. 2023-07-25T20:48:55.615 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-07-25T20:48:55.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T20:50:55.540 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-25T20:50:55.542 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi163 2023-07-25T20:50:55.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T20:50:55.543 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T20:51:00.623 INFO:teuthology.nuke:Checking targets against current locks 2023-07-25T20:51:10.697 DEBUG:teuthology.nuke:shortname: smithi105 2023-07-25T20:51:10.698 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T20:51:10.719 DEBUG:teuthology.nuke:shortname: smithi163 2023-07-25T20:51:10.719 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T20:51:10.724 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351947', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 20:34:43.262397', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-25T20:51:10.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-25_19:57:34-orch:cephadm-wip-guits-testing-4-2023-07-25-0837-quincy-distro-default-smithi/7351951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 20:35:48.917883', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrs5B89Hq4y/7WVbKUeVSVDKjOhnYggWuBmgbeQ/xzJ+hTQP6h1quOAlSrnU3gCQ6qXISWYLehv7j6ucxILAy/CzhPd85Rl7nKhF4bip4qNfBb5pxXWL2esRabReop2wXY6pNGq2JQPMjIrBQ7HPxQj2n37rGfpHbHm4kcgl9HDVhtrUzqzVHQyEMNxiLLI9y0jIKoeUoya3YeYAOC9t0pYERdE2szqmkBalJ20PEzwIQh7sTEIR0UMR8+CP5z2wxZbcjw75D9Tpzr+5K1HkMhiip+aMcH7wEj/f696uSKykQbgYo2QHUewKN479AOZLat4HlZ097pNjS8HiWkvkciqlcCE6YO36DJqqI640s7nqa2AmMv/SCES279rvewTFumtgoCc7so4AyQX/B7dD9R5xOahfVz8ilSaMX2qFScO4UsW5F/qdl1t/pPbQe81hfQOV70Xx3WXA1P2mIDMKGxCr35k07msIYUiq64On72WM9yPmkzUv543p4Nf4taoPM='} 2023-07-25T20:51:10.771 INFO:teuthology.orchestra.console:Power off smithi105 2023-07-25T20:51:10.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:51:10.787 INFO:teuthology.orchestra.console:Power off smithi163 2023-07-25T20:51:10.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T20:51:10.798 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:51:10.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:10.810 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T20:51:10.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:10.822 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:51:10.832 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T20:51:14.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:14.833 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:15.935 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:15.943 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:19.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:19.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:21.048 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:21.057 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:25.050 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:25.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:25.169 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:51:25.270 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2023-07-25T20:51:30.377 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:35.407 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:35.438 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2023-07-25T20:51:36.516 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T20:51:40.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T20:51:40.628 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T20:51:40.729 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2023-07-25T20:51:46.238 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2023-07-25T20:51:51.501 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi163