2023-11-04T03:44:14.174 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-04T03:44:14.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T03:44:14.325 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff95eff8a90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff95ed94b80>, signals=[15])
2023-11-04T03:44:14.326 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging
2023-11-04T03:44:14.327 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server
2023-11-04T03:44:14.327 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2023-11-04T03:44:14.351 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2023-11-04T03:44:14.352 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2023-11-04T03:44:14.352 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2023-11-04T03:44:14.353 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"}
2023-11-04T03:44:14.376 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"}
2023-11-04T03:44:14.441 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-04T03:44:14.444 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-04T03:44:14.490 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10)
2023-11-04T03:44:14.491 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 10}
2023-11-04T03:44:14.496 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10)
2023-11-04T03:44:14.496 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 10}
2023-11-04T03:44:14.532 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream
2023-11-04T03:44:14.532 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-04T03:44:14.537 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream
2023-11-04T03:44:14.537 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-04T03:44:14.612 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"}
2023-11-04T03:44:14.617 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"}
2023-11-04T03:44:14.662 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1}
2023-11-04T03:44:14.671 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1}
2023-11-04T03:44:14.715 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None
2023-11-04T03:44:14.718 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None
2023-11-04T03:44:14.834 INFO:teuthology.orchestra.console.smithi119:Power off
2023-11-04T03:44:14.837 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:44:14.856 INFO:teuthology.orchestra.console.smithi114:Power off
2023-11-04T03:44:14.857 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:44:34.912 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:44:34.913 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:44:34.932 DEBUG:teuthology.orchestra.console.smithi114:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:44:34.932 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:44:54.997 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:44:54.998 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:44:55.012 DEBUG:teuthology.orchestra.console.smithi114:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:44:55.013 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:45:15.072 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:45:15.073 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:15.085 DEBUG:teuthology.orchestra.console.smithi114:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:45:15.085 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:16.084 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:16.094 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:20.086 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:20.095 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:21.195 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:21.207 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:25.200 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:25.208 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:26.311 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:26.317 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:30.314 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:30.321 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:31.424 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:31.430 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:35.426 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:35.435 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:36.538 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:36.544 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:40.542 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:40.551 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:41.654 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:41.660 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:45.659 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:45.667 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:46.770 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:46.780 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:50.774 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:50.782 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:51.884 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:51.890 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:45:55.886 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:55.893 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:45:56.996 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:45:57.002 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:00.998 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:01.006 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:02.109 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:46:02.114 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:06.114 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:06.124 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:07.226 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:46:07.234 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:11.230 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:11.239 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:12.342 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:46:12.348 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:16.346 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:16.354 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:17.456 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:46:17.462 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:21.458 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:21.466 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:22.568 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:46:22.576 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:26.570 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:26.577 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:46:27.681 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:46:27.681 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-11-04T03:46:27.682 ERROR:teuthology.orchestra.console.smithi119:Failed to power off
2023-11-04T03:46:27.682 INFO:teuthology.orchestra.console.smithi119:Power on
2023-11-04T03:46:27.682 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T03:46:27.690 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:46:27.691 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-11-04T03:46:27.691 ERROR:teuthology.orchestra.console.smithi114:Failed to power off
2023-11-04T03:46:27.691 INFO:teuthology.orchestra.console.smithi114:Power on
2023-11-04T03:46:27.692 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T03:46:47.753 DEBUG:teuthology.orchestra.console.smithi119:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:46:47.754 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T03:46:47.764 DEBUG:teuthology.orchestra.console.smithi114:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:46:47.765 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T03:47:07.829 DEBUG:teuthology.orchestra.console.smithi119:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:47:07.830 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T03:47:07.838 DEBUG:teuthology.orchestra.console.smithi114:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:47:07.839 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-04T03:47:27.900 DEBUG:teuthology.orchestra.console.smithi119:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:47:27.901 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:27.909 DEBUG:teuthology.orchestra.console.smithi114:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:47:27.910 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:28.910 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:28.920 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:47:32.914 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:32.921 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:34.024 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:34.030 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:47:38.026 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:38.034 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:39.136 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:39.143 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:47:43.138 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:43.145 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:44.248 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:44.256 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:47:48.252 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:48.260 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:49.362 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:49.368 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:47:53.366 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:53.373 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:54.475 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:54.481 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:47:58.478 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:58.485 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:47:59.588 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:47:59.593 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:03.591 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:03.598 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:04.700 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:04.705 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:08.705 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:08.713 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:09.816 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:09.823 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:13.822 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:13.830 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:14.933 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:14.940 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:18.938 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:18.945 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:20.048 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:20.055 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:24.050 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:24.057 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:25.161 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:25.166 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:29.165 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:29.172 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:30.274 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:30.280 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:34.279 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:34.286 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:35.389 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:35.394 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:39.394 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:39.402 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:48:40.504 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:48:40.505 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-11-04T03:48:40.505 DEBUG:teuthology.provision.fog.smithi119:Canceling deploy task with ID 582272
2023-11-04T03:48:40.506 DEBUG:teuthology.provision.fog.smithi119:FOG request: DELETE /task/cancel {"id": 582272}
2023-11-04T03:48:40.510 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:48:40.510 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-11-04T03:48:40.511 DEBUG:teuthology.provision.fog.smithi114:Canceling deploy task with ID 582273
2023-11-04T03:48:40.511 DEBUG:teuthology.provision.fog.smithi114:FOG request: DELETE /task/cancel {"id": 582273}
2023-11-04T03:48:40.567 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi119
2023-11-04T03:48:40.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-04T03:48:40.706 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fdc101899280443c8c8f5005097cd3b2
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi119
2023-11-04T03:48:40.709 INFO:teuthology.nuke:Checking targets against current locks
2023-11-04T03:48:40.769 DEBUG:teuthology.nuke:shortname: smithi114
2023-11-04T03:48:40.769 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-04T03:48:40.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mbenjamin-2023-11-03_22:35:29-rgw-wip-notify-lctrans-distro-default-smithi/7446075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 03:44:13.359074', 'locked_by': 'scheduled_mbenjamin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-04T03:48:40.801 DEBUG:teuthology.nuke:shortname: smithi119
2023-11-04T03:48:40.802 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-04T03:48:40.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mbenjamin-2023-11-03_22:35:29-rgw-wip-notify-lctrans-distro-default-smithi/7446075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 03:44:13.360665', 'locked_by': 'scheduled_mbenjamin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIv1z74QtOhtPoVF29QvLoawG3xrUUzV8r4y7zjFLrL+eGTe2lm7r1do1iNgmk+6r0juV+UJsG+lkbh3vHPz6y4='}
2023-11-04T03:48:40.859 INFO:teuthology.orchestra.console.smithi114:Power off
2023-11-04T03:48:40.859 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:48:40.875 INFO:teuthology.orchestra.console.smithi119:Power off
2023-11-04T03:48:40.876 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:49:00.931 DEBUG:teuthology.orchestra.console.smithi114:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:49:00.932 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:49:00.945 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:49:00.946 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:49:21.000 DEBUG:teuthology.orchestra.console.smithi114:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:49:21.001 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:49:21.012 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:49:21.013 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-04T03:49:41.072 DEBUG:teuthology.orchestra.console.smithi114:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:49:41.073 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:41.084 DEBUG:teuthology.orchestra.console.smithi119:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-11-04T03:49:41.084 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:42.082 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:49:42.092 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:49:46.084 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:46.094 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:47.195 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:49:47.202 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:49:51.201 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:51.210 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:52.313 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:49:52.318 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:49:56.318 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:56.327 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:49:57.429 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:49:57.435 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:01.434 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:01.442 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:02.544 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:02.550 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:06.548 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:06.558 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:07.660 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:07.666 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:11.662 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:11.672 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:12.774 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:12.781 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:16.778 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:16.785 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:17.888 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:17.893 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:21.891 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:21.899 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:23.002 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:23.007 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:27.007 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:27.014 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:28.117 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:28.123 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:32.125 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:32.133 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:33.236 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:33.242 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:37.238 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:37.247 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:38.350 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:38.357 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:42.356 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:42.366 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:43.469 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:43.475 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:47.474 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:47.482 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:48.584 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:48.591 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:52.590 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:52.599 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-04T03:50:53.700 DEBUG:teuthology.orchestra.console.smithi114:check power output: 
2023-11-04T03:50:53.701 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-11-04T03:50:53.701 ERROR:teuthology.orchestra.console.smithi114:Failed to power off
2023-11-04T03:50:53.707 DEBUG:teuthology.orchestra.console.smithi119:check power output: 
2023-11-04T03:50:53.708 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-11-04T03:50:53.708 ERROR:teuthology.orchestra.console.smithi119:Failed to power off
2023-11-04T03:50:53.857 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com
2023-11-04T03:50:53.864 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com
2023-11-04T03:50:54.074 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi119