2023-12-02T21:55:20.848 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-02T21:55:20.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-02T21:55:21.013 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fefbe8114c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fefbf76e550>, signals=[15])
2023-12-02T21:55:21.014 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging
2023-12-02T21:55:21.014 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server
2023-12-02T21:55:21.014 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2023-12-02T21:55:21.039 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2023-12-02T21:55:21.039 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2023-12-02T21:55:21.039 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-12-02T21:55:21.063 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2023-12-02T21:55:21.064 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2023-12-02T21:55:21.064 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2023-12-02T21:55:21.192 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-02T21:55:21.264 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-02T21:55:21.291 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-02T21:55:21.326 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of ubuntu 22.04
2023-12-02T21:55:21.365 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of ubuntu 22.04
2023-12-02T21:55:21.379 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of ubuntu 22.04
2023-12-02T21:55:23.164 INFO:teuthology.orchestra.console.smithi116:Power off
2023-12-02T21:55:23.165 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-02T21:55:23.187 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off
2023-12-02T21:55:23.187 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:23.208 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on
2023-12-02T21:55:23.519 INFO:teuthology.orchestra.console.smithi142:Power off
2023-12-02T21:55:23.519 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-02T21:55:23.542 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2023-12-02T21:55:23.542 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:23.566 INFO:teuthology.orchestra.console.smithi133:Power off
2023-12-02T21:55:23.566 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-02T21:55:23.577 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-02T21:55:23.592 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2023-12-02T21:55:23.592 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:23.614 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-12-02T21:55:23.678 INFO:teuthology.orchestra.console.smithi142:Power off completed
2023-12-02T21:55:23.779 INFO:teuthology.orchestra.console.smithi142:Power on
2023-12-02T21:55:23.779 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-02T21:55:23.803 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2023-12-02T21:55:23.804 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:23.824 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-02T21:55:27.210 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:27.318 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on
2023-12-02T21:55:27.615 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:27.724 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-12-02T21:55:27.825 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:27.935 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-02T21:55:31.323 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:31.431 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on
2023-12-02T21:55:31.725 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:31.833 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-12-02T21:55:31.933 INFO:teuthology.orchestra.console.smithi133:Power off completed
2023-12-02T21:55:31.936 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:32.035 INFO:teuthology.orchestra.console.smithi133:Power on
2023-12-02T21:55:32.035 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-02T21:55:32.045 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-02T21:55:32.056 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On
2023-12-02T21:55:32.056 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:32.076 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-12-02T21:55:32.146 INFO:teuthology.orchestra.console.smithi142:Power on completed
2023-12-02T21:55:32.247 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2023-12-02T21:55:35.435 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:35.544 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off
2023-12-02T21:55:35.645 INFO:teuthology.orchestra.console.smithi116:Power off completed
2023-12-02T21:55:35.745 INFO:teuthology.orchestra.console.smithi116:Power on
2023-12-02T21:55:35.746 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-02T21:55:35.765 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On
2023-12-02T21:55:35.765 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:35.784 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off
2023-12-02T21:55:36.077 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:36.184 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-12-02T21:55:39.786 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:39.894 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on
2023-12-02T21:55:39.995 INFO:teuthology.orchestra.console.smithi116:Power on completed
2023-12-02T21:55:40.095 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish
2023-12-02T21:55:40.185 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T21:55:40.293 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-12-02T21:55:40.394 INFO:teuthology.orchestra.console.smithi133:Power on completed
2023-12-02T21:55:40.495 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2023-12-02T21:55:55.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:55:56.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:55:58.690 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:55:59.106 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:04.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:05.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:07.746 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:56:08.166 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:13.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:14.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:16.834 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:56:17.218 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:22.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:23.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:25.890 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:56:26.274 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:31.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:32.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:34.946 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:56:35.334 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:40.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:41.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:44.038 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:56:44.386 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:50.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:50.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:53.126 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:56:53.442 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:56:59.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:56:59.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:57:02.210 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:57:02.498 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T21:57:08.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:57:08.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:57:11.266 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T21:57:17.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T21:57:40.191 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:57:44.320 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:57:48.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:57:51.447 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:57:53.011 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:00.134 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:01.576 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:10.216 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:14.703 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:23.335 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:30.833 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:39.456 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:49.960 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:58:58.575 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:59:12.047 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:59:20.697 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:59:37.137 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T21:59:45.818 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:05.265 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:05.265 WARNING:teuthology.provision.fog.smithi133:'connect to smithi133.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-02T22:00:11.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:00:13.939 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:13.939 WARNING:teuthology.provision.fog.smithi116:'connect to smithi116.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-02T22:00:19.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:00:20.064 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:24.184 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:31.305 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:41.425 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:00:41.560 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-12-02T22:00:54.545 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:01:04.098 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:01:10.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:01:10.625 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:01:28.418 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:01:29.709 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:01:34.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:01:37.474 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:01:43.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:01:45.388 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:01:51.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:01:51.391 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:01:51.830 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-02T22:01:57.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:01:57.395 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:02:03.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:02:03.398 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:02:09.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:02:09.402 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-12-02T22:02:10.402 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-12-02T22:02:15.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:02:15.620 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-02T22:02:15.620 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-02T22:02:16.345 INFO:teuthology.provision.fog.smithi133:Node is ready
2023-12-02T22:02:16.345 DEBUG:teuthology.orchestra.run.smithi133:> hostname
2023-12-02T22:02:16.391 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2023-12-02T22:02:16.391 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts
2023-12-02T22:02:16.439 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2023-12-02T22:02:16.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-12-02T22:02:16.605 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts
2023-12-02T22:02:16.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts
2023-12-02T22:02:16.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname
2023-12-02T22:02:16.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-12-02T22:02:16.788 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-12-02T22:02:16.835 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-02T22:02:16.835 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu"
2023-12-02T22:02:16.835 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04"
2023-12-02T22:02:16.835 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-02T22:02:16.835 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-02T22:02:16.836 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy
2023-12-02T22:02:16.837 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2023-12-02T22:02:16.837 DEBUG:teuthology.parallel:result is None
2023-12-02T22:03:16.833 WARNING:teuthology.provision.fog.smithi116:timed out
2023-12-02T22:03:22.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:03:54.338 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T22:04:00.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:00.342 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T22:04:06.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:06.344 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T22:04:12.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:12.348 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-12-02T22:04:18.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:18.660 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-02T22:04:18.661 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-02T22:04:19.159 INFO:teuthology.provision.fog.smithi116:Node is ready
2023-12-02T22:04:19.159 DEBUG:teuthology.orchestra.run.smithi116:> hostname
2023-12-02T22:04:19.207 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com
2023-12-02T22:04:19.208 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts
2023-12-02T22:04:19.255 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116
2023-12-02T22:04:19.256 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116
2023-12-02T22:04:19.406 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts
2023-12-02T22:04:19.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts
2023-12-02T22:04:19.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname
2023-12-02T22:04:19.530 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116
2023-12-02T22:04:19.590 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release
2023-12-02T22:04:19.639 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-02T22:04:19.639 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Ubuntu"
2023-12-02T22:04:19.640 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="22.04"
2023-12-02T22:04:19.640 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-02T22:04:19.640 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_CODENAME=jammy
2023-12-02T22:04:19.640 INFO:teuthology.orchestra.run.smithi116.stdout:ID=ubuntu
2023-12-02T22:04:19.640 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE=debian
2023-12-02T22:04:19.641 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-02T22:04:19.641 INFO:teuthology.orchestra.run.smithi116.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-02T22:04:19.641 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-02T22:04:19.641 INFO:teuthology.orchestra.run.smithi116.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-02T22:04:19.641 INFO:teuthology.orchestra.run.smithi116.stdout:UBUNTU_CODENAME=jammy
2023-12-02T22:04:19.641 INFO:teuthology.provision.fog.smithi116:Deploy complete!
2023-12-02T22:04:19.641 DEBUG:teuthology.parallel:result is None
2023-12-02T22:04:38.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:41.858 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:04:47.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:50.918 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:04:56.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:04:59.970 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:05:05.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:05:09.026 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:05:15.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:05:18.082 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:05:24.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:05:27.138 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:05:33.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:05:36.194 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:05:42.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:00.546 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:06:06.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:09.602 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:06:15.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:15.606 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:06:21.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:21.609 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:06:27.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:27.614 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:06:33.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:33.618 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2023-12-02T22:06:39.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-02T22:06:39.879 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-02T22:06:39.880 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-02T22:06:40.349 INFO:teuthology.provision.fog.smithi142:Node is ready
2023-12-02T22:06:40.349 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2023-12-02T22:06:40.398 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2023-12-02T22:06:40.398 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2023-12-02T22:06:40.444 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2023-12-02T22:06:40.445 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2023-12-02T22:06:40.567 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2023-12-02T22:06:40.583 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2023-12-02T22:06:40.640 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2023-12-02T22:06:40.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2023-12-02T22:06:40.756 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2023-12-02T22:06:40.806 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-02T22:06:40.807 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Ubuntu"
2023-12-02T22:06:40.807 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="22.04"
2023-12-02T22:06:40.808 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-02T22:06:40.808 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_CODENAME=jammy
2023-12-02T22:06:40.808 INFO:teuthology.orchestra.run.smithi142.stdout:ID=ubuntu
2023-12-02T22:06:40.809 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE=debian
2023-12-02T22:06:40.809 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-02T22:06:40.809 INFO:teuthology.orchestra.run.smithi142.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-02T22:06:40.809 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-02T22:06:40.810 INFO:teuthology.orchestra.run.smithi142.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-02T22:06:40.810 INFO:teuthology.orchestra.run.smithi142.stdout:UBUNTU_CODENAME=jammy
2023-12-02T22:06:40.810 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2023-12-02T22:06:40.811 DEBUG:teuthology.parallel:result is None
2023-12-02T22:06:41.903 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-12-02T22:06:41.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-02T22:06:42.049 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=05a6b6327437456d89bab3d0473563d4
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-12-02T22:06:42.051 INFO:teuthology.nuke:Checking targets against current locks
2023-12-02T22:06:42.108 DEBUG:teuthology.nuke:shortname: smithi116
2023-12-02T22:06:42.109 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-02T22:06:42.135 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-02_21:54:05-rbd-wip-dis-testing-distro-default-smithi/7475828', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 21:55:45.265260', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLeXiWMd/eSZUlWzCaIIrWd1YWoRuQ2IBl3JQPWDD47gh66SEACneA4gL6yE71CKJfO/G+eGZ/JpnF2mncu610s='}
2023-12-02T22:06:42.139 DEBUG:teuthology.nuke:shortname: smithi133
2023-12-02T22:06:42.139 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-02T22:06:42.163 DEBUG:teuthology.nuke:shortname: smithi142
2023-12-02T22:06:42.164 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-02T22:06:42.169 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-02_21:54:05-rbd-wip-dis-testing-distro-default-smithi/7475828', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 21:55:45.266720', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGwFS1I6qX0N0PvZ9cOxwNAuwYHA0N5XZbci7XD4D7me1lnJaGZ0LKmBbktjf2gf1oHmgRJO3ZLGthoarUQKyNk='}
2023-12-02T22:06:42.196 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-02_21:54:05-rbd-wip-dis-testing-distro-default-smithi/7475813', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-02 21:55:19.993591', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}
2023-12-02T22:06:42.204 INFO:teuthology.orchestra.console.smithi116:Power off
2023-12-02T22:06:42.204 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-02T22:06:42.229 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off
2023-12-02T22:06:42.230 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:42.253 INFO:teuthology.orchestra.console.smithi133:Power off
2023-12-02T22:06:42.254 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-02T22:06:42.266 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on
2023-12-02T22:06:42.278 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2023-12-02T22:06:42.278 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:42.294 INFO:teuthology.orchestra.console.smithi142:Power off
2023-12-02T22:06:42.295 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-02T22:06:42.304 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-12-02T22:06:42.320 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2023-12-02T22:06:42.321 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:42.345 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-02T22:06:46.267 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:46.306 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:46.347 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:46.377 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off
2023-12-02T22:06:46.417 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-12-02T22:06:46.456 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2023-12-02T22:06:46.479 INFO:teuthology.orchestra.console.smithi116:Power off completed
2023-12-02T22:06:46.629 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com
2023-12-02T22:06:50.417 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:50.459 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:50.532 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-12-02T22:06:50.576 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2023-12-02T22:06:50.680 INFO:teuthology.orchestra.console.smithi142:Power off completed
2023-12-02T22:06:50.829 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2023-12-02T22:06:54.533 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-02T22:06:54.648 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-12-02T22:06:54.749 INFO:teuthology.orchestra.console.smithi133:Power off completed
2023-12-02T22:06:54.904 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2023-12-02T22:06:55.258 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range