2023-09-21T12:51:52.972 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-21T12:51:52.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T12:51:53.118 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f99bfa9bbb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f99bf83fca0>, signals=[15])
2023-09-21T12:51:53.119 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-09-21T12:51:53.120 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T12:51:53.120 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-09-21T12:51:53.139 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-09-21T12:51:53.140 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T12:51:53.140 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-09-21T12:51:53.143 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-09-21T12:51:53.172 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-09-21T12:51:53.227 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-21T12:51:53.249 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-21T12:51:53.271 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-21T12:51:53.272 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 5}
2023-09-21T12:51:53.293 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-21T12:51:53.294 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 5}
2023-09-21T12:51:53.319 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of rhel 8.6
2023-09-21T12:51:53.320 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-21T12:51:53.341 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6
2023-09-21T12:51:53.342 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-09-21T12:51:53.403 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T12:51:53.426 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T12:51:53.443 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-09-21T12:51:53.469 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-09-21T12:51:53.523 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-21T12:51:53.550 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-09-21T12:51:53.646 INFO:teuthology.orchestra.console.smithi099:Power off
2023-09-21T12:51:53.647 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:51:53.661 INFO:teuthology.orchestra.console.smithi105:Power off
2023-09-21T12:51:53.662 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:52:13.717 DEBUG:teuthology.orchestra.console.smithi099:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:52:13.718 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:52:13.731 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:52:13.732 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:52:33.789 DEBUG:teuthology.orchestra.console.smithi099:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:52:33.790 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:52:33.800 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:52:33.801 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:52:53.861 DEBUG:teuthology.orchestra.console.smithi099:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:52:53.862 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:52:53.873 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:52:53.873 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:52:54.873 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:52:54.880 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:52:58.878 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:52:58.885 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:52:59.988 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:52:59.992 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:03.994 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:04.003 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:05.106 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:05.114 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:09.111 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:09.118 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:10.221 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:10.227 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:14.226 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:14.233 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:15.335 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:15.340 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:19.341 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:19.349 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:20.452 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:20.458 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:24.454 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:24.461 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:25.564 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:25.569 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:29.566 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:29.573 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:30.676 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:30.681 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:34.682 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:34.695 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:35.798 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:35.805 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:39.802 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:39.810 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:40.912 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:40.918 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:44.918 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:44.925 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:46.028 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:46.033 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:50.034 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:50.041 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:51.144 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:51.149 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:53:55.148 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:55.157 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:53:56.260 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:53:56.265 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:54:00.262 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:54:00.270 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:54:01.373 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:54:01.380 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:54:05.378 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:54:05.385 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:54:06.488 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:54:06.490 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:54:06.491 ERROR:teuthology.orchestra.console.smithi099:Failed to power off
2023-09-21T12:54:06.491 INFO:teuthology.orchestra.console.smithi099:Power on
2023-09-21T12:54:06.491 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:54:06.499 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:54:06.500 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:54:06.500 ERROR:teuthology.orchestra.console.smithi105:Failed to power off
2023-09-21T12:54:06.501 INFO:teuthology.orchestra.console.smithi105:Power on
2023-09-21T12:54:06.501 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:54:26.561 DEBUG:teuthology.orchestra.console.smithi099:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:54:26.562 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:54:26.572 DEBUG:teuthology.orchestra.console.smithi105:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:54:26.572 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:54:46.632 DEBUG:teuthology.orchestra.console.smithi099:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:54:46.633 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:54:46.641 DEBUG:teuthology.orchestra.console.smithi105:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:54:46.642 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T12:55:06.701 DEBUG:teuthology.orchestra.console.smithi099:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:55:06.702 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:06.712 DEBUG:teuthology.orchestra.console.smithi105:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:55:06.712 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:07.712 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:07.720 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:11.716 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:11.723 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:12.826 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:12.831 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:16.830 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:16.842 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:17.945 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:17.950 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:21.950 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:21.961 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:23.064 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:23.069 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:27.069 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:27.077 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:28.180 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:28.186 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:32.182 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:32.189 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:33.292 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:33.299 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:37.298 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:37.305 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:38.408 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:38.413 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:42.410 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:42.418 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:43.520 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:43.525 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:47.526 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:47.533 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:48.637 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:48.641 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:52.642 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:52.649 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:53.751 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:53.757 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:55:57.754 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:57.762 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:55:58.865 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:55:58.871 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:56:02.870 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:02.877 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:03.979 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:56:03.985 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:56:07.982 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:07.989 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:09.092 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:56:09.098 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:56:13.098 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:13.105 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:14.211 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:56:14.212 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:56:18.215 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:18.223 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:56:19.326 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:56:19.327 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:56:19.327 DEBUG:teuthology.provision.fog.smithi099:Canceling deploy task with ID 499635
2023-09-21T12:56:19.327 DEBUG:teuthology.provision.fog.smithi099:FOG request: DELETE /task/cancel {"id": 499635}
2023-09-21T12:56:19.333 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:56:19.333 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:56:19.334 DEBUG:teuthology.provision.fog.smithi105:Canceling deploy task with ID 499636
2023-09-21T12:56:19.334 DEBUG:teuthology.provision.fog.smithi105:FOG request: DELETE /task/cancel {"id": 499636}
2023-09-21T12:56:19.384 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi105
2023-09-21T12:56:19.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T12:56:19.536 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7ad26bbe54a74a8d9aaa3e6222161d99
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi105
2023-09-21T12:56:19.538 INFO:teuthology.nuke:Checking targets against current locks
2023-09-21T12:56:19.595 DEBUG:teuthology.nuke:shortname: smithi099
2023-09-21T12:56:19.596 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T12:56:19.620 DEBUG:teuthology.nuke:shortname: smithi105
2023-09-21T12:56:19.620 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T12:56:19.624 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:51:52.122568', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFXRHbCQKDEuyNLFw4V1AtfgTXVj1Soceqgh+qxIZuwuU9XS7E6mMjA4WiDriC/6XhxlgPBiXLgPCx7jyVR8EVs='}
2023-09-21T12:56:19.643 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399915', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:51:52.120613', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJptX02Xv1cnuL+0u1sr/6lwByx6nivuBRCcqhvjH1/U0Rf2g+qKaUsMSwf+FRz6zuwx5VHORTRpsfjGGHXK4a8='}
2023-09-21T12:56:19.665 INFO:teuthology.orchestra.console.smithi099:Power off
2023-09-21T12:56:19.665 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:56:19.704 INFO:teuthology.orchestra.console.smithi105:Power off
2023-09-21T12:56:19.705 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:56:39.737 DEBUG:teuthology.orchestra.console.smithi099:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:56:39.738 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:56:39.772 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:56:39.772 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:56:59.809 DEBUG:teuthology.orchestra.console.smithi099:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:56:59.810 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:56:59.843 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:56:59.844 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T12:57:19.884 DEBUG:teuthology.orchestra.console.smithi099:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:57:19.885 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:19.911 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T12:57:19.912 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:20.897 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:20.919 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:24.900 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:24.921 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:26.010 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:26.029 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:30.014 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:30.030 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:31.124 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:31.140 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:35.125 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:35.141 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:36.236 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:36.250 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:40.237 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:40.251 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:41.347 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:41.359 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:45.350 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:45.361 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:46.460 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:46.469 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:50.462 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:50.470 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:51.573 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:51.579 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:57:55.578 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:55.585 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:57:56.688 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:57:56.693 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:00.694 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:00.702 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:01.804 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:01.811 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:05.810 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:05.818 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:06.920 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:06.926 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:10.926 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:10.933 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:12.035 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:12.041 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:16.038 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:16.046 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:17.148 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:17.154 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:21.150 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:21.159 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:22.261 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:22.267 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:26.266 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:26.274 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:27.376 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:27.383 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:31.381 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:31.389 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T12:58:32.491 DEBUG:teuthology.orchestra.console.smithi099:check power output: 
2023-09-21T12:58:32.492 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:58:32.493 ERROR:teuthology.orchestra.console.smithi099:Failed to power off
2023-09-21T12:58:32.498 DEBUG:teuthology.orchestra.console.smithi105:check power output: 
2023-09-21T12:58:32.498 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T12:58:32.499 ERROR:teuthology.orchestra.console.smithi105:Failed to power off
2023-09-21T12:58:32.644 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2023-09-21T12:58:32.650 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-09-21T12:58:32.887 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi105