2023-09-21T12:10:34.674 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-21T12:10:34.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T12:10:34.816 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9b62774d30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9b62519ca0>, signals=[15])
2023-09-21T12:10:34.818 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-09-21T12:10:34.819 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T12:10:34.819 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-21T12:10:34.851 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-09-21T12:10:34.852 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T12:10:34.852 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-09-21T12:10:34.853 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"}
2023-09-21T12:10:34.876 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"}
2023-09-21T12:10:34.932 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-21T12:10:34.946 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-21T12:10:34.974 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3)
2023-09-21T12:10:34.974 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3}
2023-09-21T12:10:34.988 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3)
2023-09-21T12:10:34.989 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3}
2023-09-21T12:10:35.024 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2023-09-21T12:10:35.024 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-21T12:10:35.028 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream
2023-09-21T12:10:35.029 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-09-21T12:10:35.094 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T12:10:35.098 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T12:10:35.135 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1}
2023-09-21T12:10:35.138 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1}
2023-09-21T12:10:35.190 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-21T12:10:35.193 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-09-21T12:10:35.296 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-21T12:10:35.297 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:10:35.312 INFO:teuthology.orchestra.console.smithi123:Power off
2023-09-21T12:10:35.312 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:10:55.369 DEBUG:teuthology.orchestra.console.smithi098:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:10:55.370 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:10:55.380 DEBUG:teuthology.orchestra.console.smithi123:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:10:55.381 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:11:15.439 DEBUG:teuthology.orchestra.console.smithi098:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:11:15.440 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:11:15.447 DEBUG:teuthology.orchestra.console.smithi123:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:11:15.448 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:11:35.509 DEBUG:teuthology.orchestra.console.smithi098:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:11:35.510 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:35.518 DEBUG:teuthology.orchestra.console.smithi123:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:11:35.519 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:36.518 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:11:36.526 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:11:40.522 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:40.529 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:41.630 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:11:41.637 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:11:45.634 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:45.641 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:46.743 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:11:46.749 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:11:50.748 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:50.755 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:51.857 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:11:51.862 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:11:55.861 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:55.867 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:11:56.970 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:11:56.976 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:00.974 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:00.981 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:02.084 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:02.089 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:06.086 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:06.093 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:07.195 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:07.201 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:11.198 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:11.204 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:12.307 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:12.312 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:16.313 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:16.320 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:17.422 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:17.428 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:21.426 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:21.432 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:22.534 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:22.540 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:26.538 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:26.544 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:27.646 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:27.652 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:31.650 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:31.657 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:32.758 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:32.764 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:36.762 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:36.769 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:37.872 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:37.877 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:41.876 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:41.883 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:42.985 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:42.990 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:46.991 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:46.998 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:12:48.101 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:12:48.101 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:12:48.102 ERROR:teuthology.orchestra.console.smithi098:Failed to power off
2023-09-21T12:12:48.102 INFO:teuthology.orchestra.console.smithi098:Power on
2023-09-21T12:12:48.103 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:12:48.110 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:12:48.110 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:12:48.111 ERROR:teuthology.orchestra.console.smithi123:Failed to power off
2023-09-21T12:12:48.111 INFO:teuthology.orchestra.console.smithi123:Power on
2023-09-21T12:12:48.111 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:13:08.172 DEBUG:teuthology.orchestra.console.smithi098:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:13:08.172 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:13:08.181 DEBUG:teuthology.orchestra.console.smithi123:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:13:08.182 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:13:28.240 DEBUG:teuthology.orchestra.console.smithi098:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:13:28.240 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:13:28.249 DEBUG:teuthology.orchestra.console.smithi123:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:13:28.249 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:13:48.313 DEBUG:teuthology.orchestra.console.smithi098:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:13:48.313 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:13:48.322 DEBUG:teuthology.orchestra.console.smithi123:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:13:48.322 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:13:49.322 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:13:49.329 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:13:53.328 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:13:53.335 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:13:54.437 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:13:54.443 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:13:58.442 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:13:58.449 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:13:59.551 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:13:59.556 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:03.554 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:03.560 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:04.662 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:04.668 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:08.666 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:08.673 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:09.777 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:09.788 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:13.782 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:13.789 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:14.891 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:14.896 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:18.895 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:18.902 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:20.005 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:20.010 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:24.010 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:24.017 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:25.120 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:25.124 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:29.122 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:29.129 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:30.231 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:30.236 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:34.234 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:34.240 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:35.343 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:35.349 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:39.346 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:39.352 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:40.455 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:40.460 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:44.458 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:44.465 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:45.567 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:45.576 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:49.570 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:49.579 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:50.682 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:50.688 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:54.686 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:54.693 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:55.794 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:14:55.800 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:14:59.798 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:14:59.805 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:15:00.908 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:15:00.908 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:15:00.909 DEBUG:teuthology.provision.fog.smithi098:Canceling deploy task with ID 499471
2023-09-21T12:15:00.909 DEBUG:teuthology.provision.fog.smithi098:FOG request: DELETE /task/cancel {"id": 499471}
2023-09-21T12:15:00.914 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:15:00.914 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:15:00.914 DEBUG:teuthology.provision.fog.smithi123:Canceling deploy task with ID 499472
2023-09-21T12:15:00.914 DEBUG:teuthology.provision.fog.smithi123:FOG request: DELETE /task/cancel {"id": 499472}
2023-09-21T12:15:00.966 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi098
2023-09-21T12:15:00.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T12:15:01.111 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=09e554bed9a04017a513702c3bd874cc
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi098
2023-09-21T12:15:01.113 INFO:teuthology.nuke:Checking targets against current locks
2023-09-21T12:15:01.176 DEBUG:teuthology.nuke:shortname: smithi098
2023-09-21T12:15:01.176 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T12:15:01.197 DEBUG:teuthology.nuke:shortname: smithi123
2023-09-21T12:15:01.197 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T12:15:01.201 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399844', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:10:33.850691', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA7O8m0rgonywG4rM5Kk/eydCwxQanlLT96+GYOYAXp72L0Rg5MIENHndfH9ozKM5CTGrEvPEa6LyVyXlesSpmg='}
2023-09-21T12:15:01.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399844', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:10:33.852513', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKcQN69TmS+gW5U2U3Orz7Z6cvS0ZgCH/S4VjOnBdsm57FdkA3rsSX0GsALdPfX6KWdklJQqrxAkkD1/2BkNOAg='}
2023-09-21T12:15:01.248 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-21T12:15:01.249 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:15:01.283 INFO:teuthology.orchestra.console.smithi123:Power off
2023-09-21T12:15:01.283 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:15:21.321 DEBUG:teuthology.orchestra.console.smithi098:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:15:21.322 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:15:21.352 DEBUG:teuthology.orchestra.console.smithi123:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:15:21.353 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:15:41.389 DEBUG:teuthology.orchestra.console.smithi098:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:15:41.390 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:15:41.420 DEBUG:teuthology.orchestra.console.smithi123:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:15:41.420 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:16:01.460 DEBUG:teuthology.orchestra.console.smithi098:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:16:01.461 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:01.491 DEBUG:teuthology.orchestra.console.smithi123:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:16:01.492 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:02.469 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:02.500 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:06.472 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:06.501 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:07.582 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:07.610 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:11.586 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:11.612 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:12.696 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:12.721 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:16.702 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:16.722 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:17.812 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:17.830 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:21.818 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:21.831 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:22.928 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:22.939 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:26.930 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:26.940 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:28.040 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:28.051 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:32.046 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:32.053 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:33.156 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:33.161 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:37.158 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:37.165 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:38.268 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:38.273 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:42.274 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:42.281 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:43.384 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:43.388 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:47.386 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:47.394 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:48.497 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:48.502 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:52.502 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:52.510 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:53.613 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:53.619 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:16:57.619 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:57.626 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:16:58.728 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:16:58.733 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:17:02.730 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:17:02.737 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:17:03.840 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:17:03.845 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:17:07.846 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:17:07.853 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:17:08.955 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:17:08.962 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:17:12.958 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:17:12.965 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:17:14.068 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-09-21T12:17:14.069 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:17:14.070 ERROR:teuthology.orchestra.console.smithi098:Failed to power off
2023-09-21T12:17:14.076 DEBUG:teuthology.orchestra.console.smithi123:check power output: 
2023-09-21T12:17:14.076 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:17:14.076 ERROR:teuthology.orchestra.console.smithi123:Failed to power off
2023-09-21T12:17:14.370 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-09-21T12:17:14.380 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2023-09-21T12:17:14.582 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi098