2023-09-21T13:45:04.895 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T13:45:04.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T13:45:05.074 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff046325670>, signals=[15]) 2023-09-21T13:45:05.075 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-09-21T13:45:05.076 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T13:45:05.076 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-09-21T13:45:05.097 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-09-21T13:45:05.097 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T13:45:05.097 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-09-21T13:45:05.099 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-09-21T13:45:05.121 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-09-21T13:45:05.121 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T13:45:05.121 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-09-21T13:45:05.123 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-09-21T13:45:05.146 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /host {"name": "smithi121"} 2023-09-21T13:45:05.185 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-21T13:45:05.189 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-21T13:45:05.222 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3) 2023-09-21T13:45:05.222 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 3} 2023-09-21T13:45:05.226 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-21T13:45:05.229 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_centos_8.stream (ID 3) 2023-09-21T13:45:05.229 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 3} 2023-09-21T13:45:05.268 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_8.stream (ID 3) 2023-09-21T13:45:05.269 DEBUG:teuthology.provision.fog.smithi121:FOG request: PUT /host/226 {"imageID": 3} 2023-09-21T13:45:05.282 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream 2023-09-21T13:45:05.282 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-09-21T13:45:05.287 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of centos 8.stream 2023-09-21T13:45:05.288 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-09-21T13:45:05.310 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.stream 2023-09-21T13:45:05.310 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-21T13:45:05.361 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T13:45:05.365 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T13:45:05.374 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T13:45:05.403 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-09-21T13:45:05.411 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-09-21T13:45:05.416 DEBUG:teuthology.provision.fog.smithi121:FOG request: POST /host/226/task {"taskTypeID": 1} 2023-09-21T13:45:05.463 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-09-21T13:45:05.469 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None 2023-09-21T13:45:05.472 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-09-21T13:45:05.596 INFO:teuthology.orchestra.console.smithi118:Power off 2023-09-21T13:45:05.597 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:05.617 INFO:teuthology.orchestra.console.smithi112:Power off 2023-09-21T13:45:05.617 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:05.628 INFO:teuthology.orchestra.console.smithi121:Power off 2023-09-21T13:45:05.629 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:25.672 DEBUG:teuthology.orchestra.console.smithi118:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:45:25.673 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:25.688 DEBUG:teuthology.orchestra.console.smithi112:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:45:25.689 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:25.699 DEBUG:teuthology.orchestra.console.smithi121:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:45:25.699 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:45.746 DEBUG:teuthology.orchestra.console.smithi118:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:45:45.747 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:45.759 DEBUG:teuthology.orchestra.console.smithi112:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:45:45.760 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:45:45.767 DEBUG:teuthology.orchestra.console.smithi121:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:45:45.768 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:46:05.821 DEBUG:teuthology.orchestra.console.smithi118:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:46:05.825 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:05.835 DEBUG:teuthology.orchestra.console.smithi112:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:46:05.835 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:05.843 DEBUG:teuthology.orchestra.console.smithi121:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:46:05.844 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:06.835 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:06.842 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:06.852 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:10.838 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:10.845 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:10.853 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:11.949 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:11.954 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:11.961 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:15.954 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:15.961 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:15.967 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:17.064 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:17.068 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:17.074 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:21.066 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:21.073 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:21.080 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:22.176 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:22.181 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:22.187 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:26.178 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:26.185 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:26.192 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:27.288 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:27.294 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:27.300 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:31.290 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:31.298 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:31.305 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:32.402 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:32.406 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:32.412 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:36.407 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:36.414 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:36.420 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:37.517 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:37.522 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:37.529 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:41.522 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:41.529 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:41.535 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:42.632 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:42.637 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:42.643 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:46.635 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:46.643 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:46.649 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:47.745 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:47.750 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:47.758 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:51.750 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:51.757 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:51.764 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:52.861 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:52.865 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:52.871 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:46:56.866 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:56.872 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:56.880 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:46:57.974 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:46:57.981 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:46:57.990 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:47:01.978 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:01.985 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:01.993 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:03.088 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:47:03.094 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:47:03.100 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:47:07.094 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:07.101 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:07.109 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:08.204 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:47:08.210 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:47:08.217 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:47:12.209 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:12.217 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:12.225 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:13.320 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:47:13.326 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:47:13.332 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:47:17.322 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:17.329 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:17.335 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:47:18.432 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:47:18.433 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:47:18.434 ERROR:teuthology.orchestra.console.smithi118:Failed to power off 2023-09-21T13:47:18.434 INFO:teuthology.orchestra.console.smithi118:Power on 2023-09-21T13:47:18.434 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:18.442 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:47:18.443 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:47:18.443 ERROR:teuthology.orchestra.console.smithi112:Failed to power off 2023-09-21T13:47:18.443 INFO:teuthology.orchestra.console.smithi112:Power on 2023-09-21T13:47:18.443 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:18.450 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:47:18.451 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:47:18.451 ERROR:teuthology.orchestra.console.smithi121:Failed to power off 2023-09-21T13:47:18.451 INFO:teuthology.orchestra.console.smithi121:Power on 2023-09-21T13:47:18.451 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:38.509 DEBUG:teuthology.orchestra.console.smithi118:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:47:38.510 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:38.519 DEBUG:teuthology.orchestra.console.smithi112:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:47:38.520 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:38.527 DEBUG:teuthology.orchestra.console.smithi121:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:47:38.528 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:58.583 DEBUG:teuthology.orchestra.console.smithi118:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:47:58.584 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:58.591 DEBUG:teuthology.orchestra.console.smithi112:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:47:58.592 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:47:58.598 DEBUG:teuthology.orchestra.console.smithi121:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:47:58.599 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T13:48:18.658 DEBUG:teuthology.orchestra.console.smithi118:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:48:18.659 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:18.667 DEBUG:teuthology.orchestra.console.smithi112:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:48:18.668 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:18.674 DEBUG:teuthology.orchestra.console.smithi121:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:48:18.675 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:19.668 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:19.674 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:19.682 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:23.670 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:23.677 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:23.684 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:24.779 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:24.785 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:24.792 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:28.784 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:28.791 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:28.798 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:29.894 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:29.899 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:29.907 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:33.899 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:33.907 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:33.914 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:35.010 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:35.015 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:35.022 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:39.014 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:39.021 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:39.027 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:40.124 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:40.128 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:40.135 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:44.129 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:44.136 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:44.143 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:45.240 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:45.244 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:45.250 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:49.242 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:49.249 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:49.256 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:50.353 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:50.358 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:50.363 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:54.358 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:54.366 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:54.374 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:55.469 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:48:55.476 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:48:55.482 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:48:59.474 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:59.480 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:48:59.487 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:00.583 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:00.588 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:00.595 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:04.586 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:04.592 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:04.599 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:05.695 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:05.700 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:05.706 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:09.698 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:09.704 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:09.711 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:10.808 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:10.812 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:10.817 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:14.810 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:14.816 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:14.822 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:15.919 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:15.923 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:15.929 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:19.924 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:19.930 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:19.938 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:21.034 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:21.039 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:21.045 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:25.039 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:25.045 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:25.052 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:26.149 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:26.154 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:26.159 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:30.154 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:30.160 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:30.167 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:49:31.263 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:49:31.264 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:49:31.264 DEBUG:teuthology.provision.fog.smithi118:Canceling deploy task with ID 499827 2023-09-21T13:49:31.265 DEBUG:teuthology.provision.fog.smithi118:FOG request: DELETE /task/cancel {"id": 499827} 2023-09-21T13:49:31.270 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:49:31.271 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:49:31.271 DEBUG:teuthology.provision.fog.smithi112:Canceling deploy task with ID 499829 2023-09-21T13:49:31.271 DEBUG:teuthology.provision.fog.smithi112:FOG request: DELETE /task/cancel {"id": 499829} 2023-09-21T13:49:31.275 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:49:31.276 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:49:31.276 DEBUG:teuthology.provision.fog.smithi121:Canceling deploy task with ID 499828 2023-09-21T13:49:31.276 DEBUG:teuthology.provision.fog.smithi121:FOG request: DELETE /task/cancel {"id": 499828} 2023-09-21T13:49:31.331 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi121 2023-09-21T13:49:31.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T13:49:31.485 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=501a8d83bacd422fa43eae753d76d58e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi121 2023-09-21T13:49:31.488 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T13:49:31.548 DEBUG:teuthology.nuke:shortname: smithi112 2023-09-21T13:49:31.548 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T13:49:31.577 DEBUG:teuthology.nuke:shortname: smithi118 2023-09-21T13:49:31.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T13:49:31.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 13:45:04.059158', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNsN1SFtSMFYxyYNcbgvW1eDZSesLM9jY4HJEMXKIWGOAdf0ieWEX3W/j2HEYjhwPyOGTJiDQ1tGjXWJ9ToC5jc='} 2023-09-21T13:49:31.609 DEBUG:teuthology.nuke:shortname: smithi121 2023-09-21T13:49:31.610 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T13:49:31.611 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 13:45:04.057605', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHRE42EXVWAQ9kqDjOQ6hOHfXJ+0+i8Bi+Rl2xk80yQLZTfeiJa0sLUT0v55bz/u7u8H3agZr2OeOhE92veP/Jk='} 2023-09-21T13:49:31.638 INFO:teuthology.orchestra.console.smithi112:Power off 2023-09-21T13:49:31.639 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:49:31.649 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398705', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 13:45:04.055760', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE1jn1oLBF86q1pnE7RuFXENl5s/X1tespMys9PDEb7ck5yZ2AevLKGrQjEtmL5Zl6NRsF5t8khgq2lSYP9XV8s='} 2023-09-21T13:49:31.682 INFO:teuthology.orchestra.console.smithi118:Power off 2023-09-21T13:49:31.682 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:49:31.721 INFO:teuthology.orchestra.console.smithi121:Power off 2023-09-21T13:49:31.722 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:49:51.709 DEBUG:teuthology.orchestra.console.smithi112:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:49:51.711 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:49:51.751 DEBUG:teuthology.orchestra.console.smithi118:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:49:51.752 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:49:51.793 DEBUG:teuthology.orchestra.console.smithi121:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:49:51.794 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:50:11.779 DEBUG:teuthology.orchestra.console.smithi112:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:50:11.780 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:50:11.820 DEBUG:teuthology.orchestra.console.smithi118:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:50:11.821 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:50:11.861 DEBUG:teuthology.orchestra.console.smithi121:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:50:11.862 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:50:31.850 DEBUG:teuthology.orchestra.console.smithi112:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:50:31.851 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:31.889 DEBUG:teuthology.orchestra.console.smithi118:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:50:31.890 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:31.933 DEBUG:teuthology.orchestra.console.smithi121:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T13:50:31.934 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:32.861 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:50:32.899 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:50:32.942 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:50:36.863 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:36.900 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:36.944 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:37.974 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:50:38.008 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:50:38.051 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:50:41.978 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:42.009 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:42.053 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:43.088 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:50:43.117 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:50:43.162 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:50:47.094 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:47.118 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:47.163 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:48.205 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:50:48.229 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:50:48.273 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:50:52.210 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:52.231 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:52.274 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:53.321 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:50:53.341 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:50:53.383 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:50:57.326 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:57.342 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:57.385 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:50:58.437 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:50:58.451 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:50:58.494 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:02.442 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:02.453 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:02.496 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:03.553 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:03.562 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:03.605 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:07.558 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:07.566 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:07.606 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:08.670 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:08.674 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:08.715 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:12.674 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:12.681 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:12.716 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:13.785 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:13.790 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:13.825 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:17.790 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:17.798 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:17.826 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:18.902 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:18.907 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:18.935 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:22.906 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:22.914 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:22.936 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:24.018 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:24.023 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:24.045 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:28.022 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:28.029 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:28.046 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:29.132 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:29.138 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:29.155 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:33.134 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:33.141 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:33.155 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:34.244 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:34.251 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:34.263 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:38.246 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:38.254 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:38.264 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:39.357 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:39.362 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:39.373 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:43.362 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:43.370 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:43.378 DEBUG:teuthology.orchestra.console.smithi121:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:51:44.473 DEBUG:teuthology.orchestra.console.smithi112:check power output: 2023-09-21T13:51:44.474 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:51:44.475 ERROR:teuthology.orchestra.console.smithi112:Failed to power off 2023-09-21T13:51:44.480 DEBUG:teuthology.orchestra.console.smithi118:check power output: 2023-09-21T13:51:44.481 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:51:44.481 ERROR:teuthology.orchestra.console.smithi118:Failed to power off 2023-09-21T13:51:44.495 DEBUG:teuthology.orchestra.console.smithi121:check power output: 2023-09-21T13:51:44.495 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T13:51:44.496 ERROR:teuthology.orchestra.console.smithi121:Failed to power off 2023-09-21T13:51:44.637 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-09-21T13:51:44.645 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-09-21T13:51:44.654 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com 2023-09-21T13:51:44.990 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi121