2023-09-21T14:27:38.819 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-21T14:27:38.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T14:27:38.949 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f417d1e6c70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f417dcd2670>, signals=[15])
2023-09-21T14:27:38.952 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-09-21T14:27:38.952 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T14:27:38.952 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-09-21T14:27:38.982 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-09-21T14:27:38.983 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T14:27:38.983 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-09-21T14:27:38.985 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-09-21T14:27:39.007 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"}
2023-09-21T14:27:39.067 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-21T14:27:39.084 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-21T14:27:39.107 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10)
2023-09-21T14:27:39.107 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 10}
2023-09-21T14:27:39.123 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10)
2023-09-21T14:27:39.124 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 10}
2023-09-21T14:27:39.172 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream
2023-09-21T14:27:39.172 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T14:27:39.175 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream
2023-09-21T14:27:39.175 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-09-21T14:27:39.248 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T14:27:39.252 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T14:27:39.287 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1}
2023-09-21T14:27:39.290 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-09-21T14:27:39.347 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-09-21T14:27:39.350 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-09-21T14:27:39.464 INFO:teuthology.orchestra.console.smithi119:Power off
2023-09-21T14:27:39.464 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:27:39.477 INFO:teuthology.orchestra.console.smithi110:Power off
2023-09-21T14:27:39.477 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:27:59.533 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:27:59.533 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:27:59.545 DEBUG:teuthology.orchestra.console.smithi110:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:27:59.545 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:28:19.606 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:28:19.606 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:28:19.615 DEBUG:teuthology.orchestra.console.smithi110:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:28:19.616 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:28:39.680 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:28:39.681 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:39.690 DEBUG:teuthology.orchestra.console.smithi110:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:28:39.690 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:40.690 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:28:40.697 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:28:44.694 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:44.701 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:45.803 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:28:45.808 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:28:49.806 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:49.812 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:50.915 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:28:50.921 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:28:54.920 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:54.928 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:28:56.031 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:28:56.036 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:00.034 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:00.043 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:01.146 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:01.151 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:05.151 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:05.158 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:06.260 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:06.265 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:10.265 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:10.275 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:11.378 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:11.383 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:15.382 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:15.389 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:16.492 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:16.500 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:20.494 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:20.501 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:21.603 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:21.609 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:25.606 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:25.614 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:26.716 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:26.721 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:30.718 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:30.725 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:31.828 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:31.833 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:35.830 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:35.837 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:36.939 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:36.944 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:40.945 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:40.952 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:42.055 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:42.060 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:46.058 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:46.064 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:47.167 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:47.171 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:51.170 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:51.177 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:29:52.280 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:29:52.281 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T14:29:52.281 ERROR:teuthology.orchestra.console.smithi119:Failed to power off
2023-09-21T14:29:52.282 INFO:teuthology.orchestra.console.smithi119:Power on
2023-09-21T14:29:52.282 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T14:29:52.290 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:29:52.290 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T14:29:52.291 ERROR:teuthology.orchestra.console.smithi110:Failed to power off
2023-09-21T14:29:52.291 INFO:teuthology.orchestra.console.smithi110:Power on
2023-09-21T14:29:52.291 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T14:30:12.353 DEBUG:teuthology.orchestra.console.smithi119:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:30:12.354 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T14:30:12.366 DEBUG:teuthology.orchestra.console.smithi110:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:30:12.366 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T14:30:32.429 DEBUG:teuthology.orchestra.console.smithi119:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:30:32.430 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T14:30:32.441 DEBUG:teuthology.orchestra.console.smithi110:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:30:32.442 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T14:30:52.504 DEBUG:teuthology.orchestra.console.smithi119:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:30:52.505 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:30:52.515 DEBUG:teuthology.orchestra.console.smithi110:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:30:52.515 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:30:53.515 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:30:53.524 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:30:57.519 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:30:57.526 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:30:58.629 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:30:58.634 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:02.634 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:02.641 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:03.744 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:03.750 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:07.746 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:07.753 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:08.855 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:08.861 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:12.858 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:12.865 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:13.968 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:13.973 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:17.973 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:17.980 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:19.082 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:19.087 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:23.086 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:23.092 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:24.195 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:24.201 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:28.198 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:28.206 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:29.308 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:29.314 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:33.310 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:33.317 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:34.420 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:34.425 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:38.426 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:38.433 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:39.535 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:39.541 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:43.541 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:43.551 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:44.654 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:44.660 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:48.658 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:48.664 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:49.766 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:49.771 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:53.770 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:53.777 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:54.880 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:54.884 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:31:58.882 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:58.889 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:31:59.991 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:31:59.998 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:32:03.997 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:32:04.003 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:32:05.106 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:32:05.107 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T14:32:05.107 DEBUG:teuthology.provision.fog.smithi119:Canceling deploy task with ID 500025
2023-09-21T14:32:05.107 DEBUG:teuthology.provision.fog.smithi119:FOG request: DELETE /task/cancel {"id": 500025}
2023-09-21T14:32:05.113 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:32:05.113 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T14:32:05.113 DEBUG:teuthology.provision.fog.smithi110:Canceling deploy task with ID 500026
2023-09-21T14:32:05.114 DEBUG:teuthology.provision.fog.smithi110:FOG request: DELETE /task/cancel {"id": 500026}
2023-09-21T14:32:05.164 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi119
2023-09-21T14:32:05.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T14:32:05.311 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2a04e4486a574bc9a68ae310dc3cfe9c
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi119
2023-09-21T14:32:05.313 INFO:teuthology.nuke:Checking targets against current locks
2023-09-21T14:32:05.372 DEBUG:teuthology.nuke:shortname: smithi110
2023-09-21T14:32:05.373 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T14:32:05.394 DEBUG:teuthology.nuke:shortname: smithi119
2023-09-21T14:32:05.394 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T14:32:05.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398816', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 14:27:38.044888', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLH15lhs6mMmDHFGpdBB16wtVR7ydtDsuyvKFjdKxRrfl7qrh+qcKGU5yB0SJo7JVYjbBB/bEzhiFCKoL0P0Fzk='}
2023-09-21T14:32:05.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398816', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 14:27:38.043767', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-21T14:32:05.447 INFO:teuthology.orchestra.console.smithi110:Power off
2023-09-21T14:32:05.448 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:32:05.486 INFO:teuthology.orchestra.console.smithi119:Power off
2023-09-21T14:32:05.487 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:32:25.517 DEBUG:teuthology.orchestra.console.smithi110:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:32:25.518 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:32:25.556 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:32:25.556 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:32:45.589 DEBUG:teuthology.orchestra.console.smithi110:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:32:45.590 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:32:45.629 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:32:45.630 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:33:05.657 DEBUG:teuthology.orchestra.console.smithi110:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:33:05.658 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:05.699 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:33:05.700 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:06.667 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:06.708 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:10.669 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:10.710 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:11.780 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:11.819 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:15.785 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:15.820 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:16.896 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:16.930 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:20.901 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:20.931 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:22.012 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:22.041 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:26.018 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:26.041 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:27.129 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:27.151 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:31.134 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:31.152 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:32.245 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:32.264 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:36.250 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:36.266 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:37.361 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:37.376 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:41.366 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:41.378 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:42.476 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:42.488 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:46.478 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:46.489 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:47.589 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:47.598 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:51.594 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:51.602 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:52.704 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:52.710 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:33:56.706 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:56.713 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:33:57.815 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:33:57.821 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:34:01.818 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:01.826 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:02.929 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:34:02.935 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:34:06.935 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:06.943 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:08.046 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:34:08.052 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:34:12.050 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:12.058 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:13.161 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:34:13.166 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:34:17.166 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:17.173 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:34:18.277 DEBUG:teuthology.orchestra.console.smithi110:check power output: 
2023-09-21T14:34:18.278 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T14:34:18.278 ERROR:teuthology.orchestra.console.smithi110:Failed to power off
2023-09-21T14:34:18.283 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-09-21T14:34:18.283 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T14:34:18.284 ERROR:teuthology.orchestra.console.smithi119:Failed to power off
2023-09-21T14:34:18.430 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2023-09-21T14:34:18.438 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com
2023-09-21T14:34:18.677 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi119