2023-09-21T14:31:31.495 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T14:31:31.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T14:31:31.666 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd1b921f670>, signals=[15]) 2023-09-21T14:31:31.667 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-09-21T14:31:31.668 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T14:31:31.668 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-09-21T14:31:31.691 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-09-21T14:31:31.691 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T14:31:31.691 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-09-21T14:31:31.693 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-09-21T14:31:31.715 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-09-21T14:31:31.715 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T14:31:31.716 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-09-21T14:31:31.717 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-09-21T14:31:31.740 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-09-21T14:31:31.760 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T14:31:31.783 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T14:31:31.811 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T14:31:31.812 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 5} 2023-09-21T14:31:31.823 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-21T14:31:31.826 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T14:31:31.826 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 5} 2023-09-21T14:31:31.858 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.6 2023-09-21T14:31:31.859 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-09-21T14:31:31.862 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-21T14:31:31.862 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 5} 2023-09-21T14:31:31.867 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of rhel 8.6 2023-09-21T14:31:31.867 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-21T14:31:31.900 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6 2023-09-21T14:31:31.900 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-09-21T14:31:31.945 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T14:31:31.949 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T14:31:31.986 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-09-21T14:31:31.991 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T14:31:31.994 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-09-21T14:31:32.035 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-09-21T14:31:32.045 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-09-21T14:31:32.048 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-09-21T14:31:32.090 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-09-21T14:31:32.171 INFO:teuthology.orchestra.console.smithi105:Power off 2023-09-21T14:31:32.172 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:31:32.186 INFO:teuthology.orchestra.console.smithi125:Power off 2023-09-21T14:31:32.187 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:31:32.198 INFO:teuthology.orchestra.console.smithi097:Power off 2023-09-21T14:31:32.199 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:31:52.240 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:31:52.241 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:31:52.261 DEBUG:teuthology.orchestra.console.smithi125:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:31:52.262 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:31:52.269 DEBUG:teuthology.orchestra.console.smithi097:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:31:52.270 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:32:12.313 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:32:12.314 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:32:12.327 DEBUG:teuthology.orchestra.console.smithi125:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:32:12.328 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:32:12.335 DEBUG:teuthology.orchestra.console.smithi097:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:32:12.336 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:32:32.385 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:32:32.386 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:32.395 DEBUG:teuthology.orchestra.console.smithi125:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:32:32.396 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:32.404 DEBUG:teuthology.orchestra.console.smithi097:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:32:32.404 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:33.396 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:32:33.403 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:32:33.412 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:32:37.398 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:37.409 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:37.416 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:38.512 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:32:38.517 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:32:38.523 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:32:42.514 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:42.521 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:42.528 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:43.624 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:32:43.629 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:32:43.635 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:32:47.626 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:47.633 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:47.640 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:48.736 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:32:48.742 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:32:48.748 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:32:52.740 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:52.747 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:52.753 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:53.850 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:32:53.855 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:32:53.860 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:32:57.854 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:57.861 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:57.867 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:32:58.964 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:32:58.968 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:32:58.974 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:02.970 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:02.977 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:02.983 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:04.080 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:04.084 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:04.091 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:08.082 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:08.089 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:08.098 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:09.192 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:09.199 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:09.207 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:13.197 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:13.205 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:13.212 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:14.309 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:14.313 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:14.318 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:18.310 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:18.318 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:18.325 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:19.421 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:19.426 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:19.433 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:23.426 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:23.434 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:23.440 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:24.540 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:24.542 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:24.548 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:28.544 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:28.552 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:28.558 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:29.655 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:29.659 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:29.665 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:33.658 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:33.665 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:33.672 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:34.768 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:34.773 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:34.779 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:38.770 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:38.777 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:38.784 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:39.880 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:39.886 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:39.893 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:43.882 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:43.889 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:43.895 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:33:44.992 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:33:44.993 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:33:44.994 ERROR:teuthology.orchestra.console.smithi105:Failed to power off 2023-09-21T14:33:44.994 INFO:teuthology.orchestra.console.smithi105:Power on 2023-09-21T14:33:44.995 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:33:45.005 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:33:45.005 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:33:45.006 ERROR:teuthology.orchestra.console.smithi125:Failed to power off 2023-09-21T14:33:45.006 INFO:teuthology.orchestra.console.smithi125:Power on 2023-09-21T14:33:45.006 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:33:45.013 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:33:45.013 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:33:45.014 ERROR:teuthology.orchestra.console.smithi097:Failed to power off 2023-09-21T14:33:45.014 INFO:teuthology.orchestra.console.smithi097:Power on 2023-09-21T14:33:45.014 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:05.069 DEBUG:teuthology.orchestra.console.smithi105:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:05.070 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:05.078 DEBUG:teuthology.orchestra.console.smithi125:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:05.079 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:05.086 DEBUG:teuthology.orchestra.console.smithi097:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:05.087 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:25.138 DEBUG:teuthology.orchestra.console.smithi105:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:25.139 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:25.150 DEBUG:teuthology.orchestra.console.smithi125:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:25.151 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:25.159 DEBUG:teuthology.orchestra.console.smithi097:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:25.159 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T14:34:45.210 DEBUG:teuthology.orchestra.console.smithi105:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:45.211 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:45.224 DEBUG:teuthology.orchestra.console.smithi125:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:45.225 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:45.233 DEBUG:teuthology.orchestra.console.smithi097:power on output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:34:45.234 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:46.222 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:34:46.232 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:34:46.240 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:34:50.227 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:50.234 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:50.242 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:51.337 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:34:51.343 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:34:51.351 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:34:55.342 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:55.349 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:55.356 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:34:56.452 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:34:56.457 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:34:56.463 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:00.454 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:00.460 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:00.468 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:01.563 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:01.569 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:01.576 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:05.565 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:05.573 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:05.579 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:06.675 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:06.681 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:06.690 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:10.681 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:10.689 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:10.697 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:11.791 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:11.798 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:11.806 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:15.797 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:15.805 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:15.812 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:16.908 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:16.913 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:16.921 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:20.913 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:20.921 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:20.927 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:22.024 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:22.028 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:22.034 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:26.026 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:26.033 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:26.040 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:27.136 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:27.142 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:27.148 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:31.141 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:31.148 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:31.156 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:32.250 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:32.258 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:32.263 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:36.254 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:36.261 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:36.270 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:37.364 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:37.372 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:37.380 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:41.370 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:41.378 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:41.385 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:42.481 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:42.486 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:42.494 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:46.486 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:46.493 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:46.500 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:47.596 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:47.601 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:47.609 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:51.598 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:51.605 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:51.611 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:52.708 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:52.713 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:52.719 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:56.712 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:56.719 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:56.727 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:35:57.823 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:35:57.824 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:35:57.824 DEBUG:teuthology.provision.fog.smithi105:Canceling deploy task with ID 500039 2023-09-21T14:35:57.825 DEBUG:teuthology.provision.fog.smithi105:FOG request: DELETE /task/cancel {"id": 500039} 2023-09-21T14:35:57.830 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:35:57.830 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:35:57.831 DEBUG:teuthology.provision.fog.smithi125:Canceling deploy task with ID 500040 2023-09-21T14:35:57.831 DEBUG:teuthology.provision.fog.smithi125:FOG request: DELETE /task/cancel {"id": 500040} 2023-09-21T14:35:57.835 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:35:57.835 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:35:57.835 DEBUG:teuthology.provision.fog.smithi097:Canceling deploy task with ID 500038 2023-09-21T14:35:57.835 DEBUG:teuthology.provision.fog.smithi097:FOG request: DELETE /task/cancel {"id": 500038} 2023-09-21T14:35:57.887 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi097 2023-09-21T14:35:57.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T14:35:58.034 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=210e00c65d9949e8bcca1510bc6b94a9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi097 2023-09-21T14:35:58.037 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T14:35:58.103 DEBUG:teuthology.nuke:shortname: smithi097 2023-09-21T14:35:58.103 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T14:35:58.126 DEBUG:teuthology.nuke:shortname: smithi105 2023-09-21T14:35:58.126 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T14:35:58.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 14:31:30.665546', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5PsAo33mTwEeo1Eu0EdUZ9KfA//4SDOy28XEJkXGfqNMeL3b7Qq8CbTO4CRaDEUE+6minPuzhmX0SCWe1ivyc='} 2023-09-21T14:35:58.154 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 14:31:30.667285', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJptX02Xv1cnuL+0u1sr/6lwByx6nivuBRCcqhvjH1/U0Rf2g+qKaUsMSwf+FRz6zuwx5VHORTRpsfjGGHXK4a8='} 2023-09-21T14:35:58.159 DEBUG:teuthology.nuke:shortname: smithi125 2023-09-21T14:35:58.160 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T14:35:58.187 INFO:teuthology.orchestra.console.smithi097:Power off 2023-09-21T14:35:58.188 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:35:58.201 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 14:31:30.663549', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKrKaocHzvsx1FEGng3U74HTVChGLdJF4uALWtSJ6xbpJspvUuq2DiepEzmRIrn+LgzLzLIgo9uiaz6dsWDgbHk='} 2023-09-21T14:35:58.230 INFO:teuthology.orchestra.console.smithi105:Power off 2023-09-21T14:35:58.230 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:35:58.264 INFO:teuthology.orchestra.console.smithi125:Power off 2023-09-21T14:35:58.265 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:18.260 DEBUG:teuthology.orchestra.console.smithi097:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:18.261 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:18.299 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:18.300 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:18.331 DEBUG:teuthology.orchestra.console.smithi125:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:18.332 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:38.334 DEBUG:teuthology.orchestra.console.smithi097:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:38.335 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:38.367 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:38.368 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:38.405 DEBUG:teuthology.orchestra.console.smithi125:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:38.406 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T14:36:58.401 DEBUG:teuthology.orchestra.console.smithi097:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:58.402 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:36:58.435 DEBUG:teuthology.orchestra.console.smithi105:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:58.436 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:36:58.481 DEBUG:teuthology.orchestra.console.smithi125:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T14:36:58.482 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:36:59.411 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:36:59.443 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:36:59.490 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:03.413 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:03.445 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:03.491 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:04.525 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:04.554 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:04.601 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:08.530 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:08.555 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:08.602 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:09.641 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:09.668 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:09.710 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:13.646 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:13.670 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:13.711 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:14.758 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:14.779 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:14.823 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:18.762 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:18.780 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:18.824 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:19.874 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:19.889 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:19.933 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:23.878 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:23.890 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:23.935 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:24.988 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:25.000 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:25.045 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:28.990 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:29.001 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:29.046 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:30.101 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:30.110 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:30.156 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:34.106 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:34.114 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:34.157 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:35.216 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:35.223 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:35.268 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:39.222 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:39.230 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:39.269 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:40.333 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:40.339 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:40.381 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:44.338 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:44.346 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:44.383 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:45.449 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:45.454 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:45.493 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:49.454 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:49.461 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:49.495 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:50.564 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:50.571 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:50.605 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:54.570 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:54.577 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:54.606 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:55.681 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:37:55.685 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:37:55.715 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:37:59.686 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:59.693 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:37:59.716 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:00.796 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:38:00.802 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:38:00.824 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:38:04.801 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:04.809 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:04.825 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:05.912 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:38:05.918 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:38:05.934 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:38:09.918 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:09.926 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:09.936 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T14:38:11.029 DEBUG:teuthology.orchestra.console.smithi097:check power output: 2023-09-21T14:38:11.030 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:38:11.031 ERROR:teuthology.orchestra.console.smithi097:Failed to power off 2023-09-21T14:38:11.036 DEBUG:teuthology.orchestra.console.smithi105:check power output: 2023-09-21T14:38:11.037 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:38:11.037 ERROR:teuthology.orchestra.console.smithi105:Failed to power off 2023-09-21T14:38:11.052 DEBUG:teuthology.orchestra.console.smithi125:check power output: 2023-09-21T14:38:11.052 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T14:38:11.053 ERROR:teuthology.orchestra.console.smithi125:Failed to power off 2023-09-21T14:38:11.190 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2023-09-21T14:38:11.207 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-09-21T14:38:11.217 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2023-09-21T14:38:11.522 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi097