2023-07-25T13:51:31.671 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-25T13:51:31.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T13:51:31.673 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T13:51:41.849 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a0c685430>, signals=[15]) 2023-07-25T13:51:41.851 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-07-25T13:51:41.851 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T13:51:41.851 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-07-25T13:51:46.894 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-07-25T13:51:46.894 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-07-25T13:51:46.894 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-07-25T13:51:46.896 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-07-25T13:51:56.928 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"} 2023-07-25T13:52:06.987 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-25T13:52:07.090 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-25T13:52:07.135 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-25T13:52:07.136 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 6} 2023-07-25T13:52:07.143 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-25T13:52:07.143 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 6} 2023-07-25T13:52:07.175 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of ubuntu 22.04 2023-07-25T13:52:07.175 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:52:07.188 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of ubuntu 22.04 2023-07-25T13:52:07.188 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:52:07.216 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T13:52:07.222 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-07-25T13:52:07.253 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-07-25T13:52:07.255 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1} 2023-07-25T13:52:07.309 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:52:07.311 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:52:12.046 INFO:teuthology.orchestra.console:Power off smithi173 2023-07-25T13:52:12.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T13:52:12.065 INFO:teuthology.orchestra.console:Power off smithi132 2023-07-25T13:52:12.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T13:52:12.075 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T13:52:12.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:12.087 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T13:52:12.088 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:13.086 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:13.096 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:17.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:17.097 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:18.200 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:18.208 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:22.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:22.210 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:23.313 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:23.321 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:27.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:27.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:27.425 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T13:52:27.433 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T13:52:27.527 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2023-07-25T13:52:27.534 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-07-25T13:52:27.628 INFO:teuthology.orchestra.console:Power on smithi173 2023-07-25T13:52:27.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T13:52:27.638 INFO:teuthology.orchestra.console:Power on smithi132 2023-07-25T13:52:27.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-25T13:52:27.650 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T13:52:27.651 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:27.660 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-25T13:52:27.661 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:27.671 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T13:52:27.680 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T13:52:31.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:31.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:32.788 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:32.794 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:36.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:36.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:37.900 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:37.906 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:41.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:41.910 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:43.013 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:43.020 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:47.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:47.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:48.126 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:48.132 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:52.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:52.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:52.238 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T13:52:52.339 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2023-07-25T13:52:52.440 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-07-25T13:52:52.441 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:52:53.246 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:52:57.248 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:52:57.357 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T13:52:57.458 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2023-07-25T13:52:57.558 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-07-25T13:52:57.559 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:53:07.496 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:53:17.118 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:53:22.560 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:53:32.187 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:53:42.634 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:53:52.256 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:54:02.712 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:54:12.333 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:54:22.787 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-07-25T13:54:27.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:54:27.922 ERROR:teuthology.orchestra.connection:Error authenticating with smithi173.front.sepia.ceph.com: Authentication failed. 2023-07-25T13:54:27.924 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T13:54:27.924 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T13:54:27.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:28.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:29.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:30.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:31.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:32.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:33.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:34.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:35.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:36.962 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:37.410 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-07-25T13:54:39.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:39.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:54:39.882 ERROR:teuthology.orchestra.connection:Error authenticating with smithi132.front.sepia.ceph.com: Authentication failed. 2023-07-25T13:54:39.883 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-25T13:54:39.883 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-25T13:54:39.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:40.756 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:40.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:41.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:41.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:42.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:42.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:43.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:43.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:44.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:44.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:45.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:45.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:46.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:46.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:47.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:47.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:48.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:48.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:49.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:49.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:50.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:50.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:51.845 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:51.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:52.853 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:52.988 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:53.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:53.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:54.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:55.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:55.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:56.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:56.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:57.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:57.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:58.030 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:58.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:59.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:54:59.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:00.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:00.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:01.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:01.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:02.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:02.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:03.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:03.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:04.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:04.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:05.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:05.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:06.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:06.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:07.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:07.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:08.113 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:08.988 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:09.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:09.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:10.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:11.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:11.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:12.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:12.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:13.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:13.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:14.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:14.167 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:15.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:15.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:16.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:16.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:17.060 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:17.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:18.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:18.202 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:19.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:19.210 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:20.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:20.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:21.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:21.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:22.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:22.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:23.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:23.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:24.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:24.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:25.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:25.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:26.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:26.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:27.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:27.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:28.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:28.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:29.164 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:29.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:30.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:30.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:31.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:31.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:32.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:32.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:33.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:33.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:34.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:34.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:35.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:35.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:36.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:36.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:37.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:37.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:38.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:38.375 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:39.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:39.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:40.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:40.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:41.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:41.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:42.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:42.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:43.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:43.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:44.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:44.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:45.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:45.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:46.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:46.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:47.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:47.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:48.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:48.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:49.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:49.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:50.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:50.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:51.352 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:51.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:52.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:52.494 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:53.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:53.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:54.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:54.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:55.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:55.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:56.397 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:56.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:57.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:57.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:58.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:58.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:59.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:55:59.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:00.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:00.564 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:01.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:01.572 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:02.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:02.581 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:03.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:03.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:04.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:04.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:05.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:05.607 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:06.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:06.615 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:07.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:07.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:08.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:08.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:09.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:09.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:10.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:10.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:11.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:11.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:12.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:12.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:13.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:13.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:14.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:14.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:15.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:15.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:16.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:16.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:17.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:17.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:18.588 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:18.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:19.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:19.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:20.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:20.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:21.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:21.739 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:22.621 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:22.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:23.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:23.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:24.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:24.766 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:25.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:25.775 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:26.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:26.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:27.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:27.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:27.852 ERROR:teuthology.provision.fog: on smithi173 2023-07-25T13:56:28.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:29.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:30.807 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:31.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:32.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:33.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:34.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:35.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:36.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-25T13:56:36.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-25T13:56:36.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:56:41.863 ERROR:teuthology.provision.fog: on smithi132 2023-07-25T13:56:50.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-07-25T13:56:50.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:57:30.352 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-25T13:57:39.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-07-25T13:57:39.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:57:44.361 ERROR:teuthology.orchestra.connection:Error authenticating with smithi173.front.sepia.ceph.com: No SSH private key found! 2023-07-25T13:57:44.362 DEBUG:teuthology.orchestra.remote:No existing session 2023-07-25T13:57:53.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-25T13:57:53.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:58:02.864 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-25T13:58:14.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-07-25T13:58:14.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:58:19.872 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-25T13:58:19.873 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-25T13:58:22.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-07-25T13:58:22.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:58:24.918 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-07-25T13:58:24.919 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-25T13:58:24.921 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi132 2023-07-25T13:58:24.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T13:58:24.922 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-25T13:58:29.632 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-25T13:58:29.727 INFO:teuthology.nuke:Checking targets against current locks 2023-07-25T13:58:29.783 DEBUG:teuthology.nuke:shortname: smithi132 2023-07-25T13:58:29.784 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T13:58:29.810 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:25:54-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7350639', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 13:51:30.820005', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGezefECPglj/PiTNgEXunLTb0pxEfL6fdFuAypdgRcsArptskTc/7tROcUGfLqY1wDkmc+1oN4v+1aXOAhLN0k='} 2023-07-25T13:58:29.813 DEBUG:teuthology.nuke:shortname: smithi173 2023-07-25T13:58:29.813 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T13:58:29.840 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:25:54-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7350639', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 13:51:30.817741', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKp0CENoOFdIjqp0dzkelyEWpH+iV1LvEmCci2qOqejC36hlbeDRXvDvA9zIowsxM5zEjWk+XPeTtovBuFwkLNQ='} 2023-07-25T13:58:29.874 INFO:teuthology.orchestra.console:Power off smithi132 2023-07-25T13:58:29.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T13:58:29.896 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T13:58:29.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:29.912 INFO:teuthology.orchestra.console:Power off smithi173 2023-07-25T13:58:29.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-25T13:58:29.922 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T13:58:31.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-25T13:58:31.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:58:36.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:36.891 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-25T13:58:36.992 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T13:58:39.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-07-25T13:58:39.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T13:58:44.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:44.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-07-25T13:58:44.911 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-25T13:58:44.943 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-25T13:58:44.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:44.965 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T13:58:46.011 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:58:48.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:49.079 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-25T13:58:50.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:51.125 DEBUG:teuthology.orchestra.console:check power output: 2023-07-25T13:58:53.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:58:53.195 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T13:58:53.296 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2023-07-25T13:58:58.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-25T13:59:03.445 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-25T13:59:03.470 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com 2023-07-25T13:59:03.547 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-07-25T13:59:13.709 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-07-25T13:59:23.994 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi132