2023-07-21T18:33:43.340 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T18:33:43.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:33:43.342 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:34:15.952 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1b28429d0>, signals=[15]) 2023-07-21T18:34:15.954 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-07-21T18:34:15.955 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:34:15.956 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-07-21T18:34:15.974 INFO:teuthology.lock.ops:Start node 'smithi082.front.sepia.ceph.com' reimaging 2023-07-21T18:34:15.974 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:34:15.975 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2023-07-21T18:34:15.976 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-07-21T18:34:21.007 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-07-21T18:34:21.007 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:34:21.007 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-07-21T18:34:21.009 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /host {"name": "smithi082"} 2023-07-21T18:34:31.027 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2023-07-21T18:34:31.028 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:34:31.028 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-07-21T18:34:31.029 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-07-21T18:34:45.627 INFO:teuthology.lock.ops:Start node 'smithi157.front.sepia.ceph.com' reimaging 2023-07-21T18:34:45.628 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T18:34:45.628 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2023-07-21T18:34:45.629 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-21T18:34:45.631 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /host {"name": "smithi150"} 2023-07-21T18:35:00.648 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-21T18:35:10.659 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-21T18:35:10.659 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 6} 2023-07-21T18:35:10.663 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /host {"name": "smithi157"} 2023-07-21T18:35:10.683 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-21T18:35:13.249 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-21T18:35:13.250 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 6} 2023-07-21T18:35:13.251 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of ubuntu 22.04 2023-07-21T18:35:13.251 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:35:13.252 DEBUG:teuthology.provision.fog.smithi082:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-21T18:35:13.252 DEBUG:teuthology.provision.fog.smithi082:FOG request: PUT /host/187 {"imageID": 6} 2023-07-21T18:35:13.284 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-21T18:35:13.288 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-07-21T18:35:13.309 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of ubuntu 22.04 2023-07-21T18:35:13.309 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:35:13.312 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of ubuntu 22.04 2023-07-21T18:35:13.312 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:35:13.315 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:35:13.333 DEBUG:teuthology.provision.fog.smithi157:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-21T18:35:13.333 DEBUG:teuthology.provision.fog.smithi157:FOG request: PUT /host/262 {"imageID": 6} 2023-07-21T18:35:13.341 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-07-21T18:35:13.341 DEBUG:teuthology.provision.fog.smithi150:FOG request: PUT /host/255 {"imageID": 6} 2023-07-21T18:35:13.361 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-07-21T18:35:13.368 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of ubuntu 22.04 2023-07-21T18:35:13.369 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:35:13.372 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:35:13.374 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:35:13.395 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of ubuntu 22.04 2023-07-21T18:35:13.396 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T18:35:13.415 DEBUG:teuthology.provision.fog.smithi082:FOG request: POST /host/187/task {"taskTypeID": 1} 2023-07-21T18:35:13.418 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:35:13.420 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-07-21T18:35:13.424 DEBUG:teuthology.provision.fog.smithi157:Canceling deploy task with ID 401721 2023-07-21T18:35:13.424 DEBUG:teuthology.provision.fog.smithi157:FOG request: DELETE /task/cancel {"id": 401721} 2023-07-21T18:35:13.448 DEBUG:teuthology.provision.fog.smithi150:Canceling deploy task with ID 401720 2023-07-21T18:35:13.448 DEBUG:teuthology.provision.fog.smithi150:FOG request: DELETE /task/cancel {"id": 401720} 2023-07-21T18:35:13.471 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:35:13.482 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:35:13.486 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:35:13.494 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T18:35:13.511 INFO:teuthology.orchestra.console:Power off smithi017 2023-07-21T18:35:13.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:35:13.530 DEBUG:teuthology.provision.fog.smithi157:FOG request: POST /host/262/task {"taskTypeID": 1} 2023-07-21T18:35:13.533 DEBUG:teuthology.provision.fog.smithi150:FOG request: POST /host/255/task {"taskTypeID": 1} 2023-07-21T18:35:13.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:13.577 INFO:teuthology.orchestra.console:Power off smithi082 2023-07-21T18:35:13.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:35:13.594 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:35:13.595 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T18:35:13.604 INFO:teuthology.orchestra.console:Power off smithi088 2023-07-21T18:35:13.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:35:13.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:13.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:13.718 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-21T18:35:13.719 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:35:13.735 INFO:teuthology.orchestra.console:Power off smithi157 2023-07-21T18:35:13.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:35:13.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:13.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:13.766 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-07-21T18:35:13.867 INFO:teuthology.orchestra.console:Power on smithi088 2023-07-21T18:35:13.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:35:13.877 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-21T18:35:13.880 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2023-07-21T18:35:13.889 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:13.979 INFO:teuthology.orchestra.console:Power on smithi150 2023-07-21T18:35:13.979 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:35:13.988 INFO:teuthology.orchestra.console:Power on smithi157 2023-07-21T18:35:13.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:35:14.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:14.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:17.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:17.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:17.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:18.025 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:18.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:21.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:21.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:23.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:23.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:23.149 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:26.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:26.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:28.138 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:28.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:28.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:31.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:31.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:32.110 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2023-07-21T18:35:32.212 INFO:teuthology.orchestra.console:Power on smithi017 2023-07-21T18:35:32.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:35:32.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:33.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:33.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:33.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:36.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:37.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:37.301 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-07-21T18:35:37.403 INFO:teuthology.orchestra.console:Power on smithi082 2023-07-21T18:35:37.403 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T18:35:37.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:38.370 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:38.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:38.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:41.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:41.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:41.660 INFO:teuthology.orchestra.console:Power on for smithi082 completed 2023-07-21T18:35:41.761 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish 2023-07-21T18:35:41.762 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:35:43.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:43.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:43.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:46.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:48.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:48.694 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:48.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:48.918 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2023-07-21T18:35:49.019 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2023-07-21T18:35:49.020 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:35:51.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:53.706 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:53.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:53.918 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2023-07-21T18:35:54.019 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-07-21T18:35:54.019 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:35:56.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:35:56.818 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:36:00.907 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:04.082 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:36:04.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:06.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:09.083 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:36:10.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:11.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:15.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:15.971 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:36:20.977 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:20.986 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:36:21.091 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2023-07-21T18:36:21.192 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-07-21T18:36:21.192 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:36:26.198 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:36:31.205 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:36.044 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:36:36.046 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:36:36.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:37.426 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds 2023-07-21T18:36:37.427 DEBUG:teuthology.provision.fog.smithi150:Canceling deploy task with ID 401728 2023-07-21T18:36:37.427 DEBUG:teuthology.provision.fog.smithi150:FOG request: DELETE /task/cancel {"id": 401728} 2023-07-21T18:36:37.483 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/console.py", line 243, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi150 2023-07-21T18:36:37.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T18:36:37.485 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T18:36:39.824 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T18:36:39.884 DEBUG:teuthology.nuke:shortname: smithi017 2023-07-21T18:36:39.884 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:36:39.909 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:33:33.287295', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPEq/D8JR3y9KpPKKLA/S7ZWVArA5woHcWKth2wrKyZ3xPIjBL0r33+UGHkeER5NOH3Wfx7PHEZGmLcJqdjVhC0='} 2023-07-21T18:36:39.921 DEBUG:teuthology.nuke:shortname: smithi082 2023-07-21T18:36:39.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:36:39.940 DEBUG:teuthology.nuke:shortname: smithi088 2023-07-21T18:36:39.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:36:39.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:33:33.284968', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJXhPtEZ3YFNj0lBaExdbAuhvilyowDopXDY6fDkdsAMUBqG341KAG1FSY8HP4LWjtkHfzAZX/SKO5YZE3lUZE='} 2023-07-21T18:36:39.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:33:33.289114', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T18:36:39.969 DEBUG:teuthology.nuke:shortname: smithi150 2023-07-21T18:36:39.970 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:36:39.977 INFO:teuthology.orchestra.console:Power off smithi017 2023-07-21T18:36:39.978 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:36:39.991 DEBUG:teuthology.nuke:shortname: smithi157 2023-07-21T18:36:39.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T18:36:40.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:40.011 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:33:33.290613', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T18:36:40.020 INFO:teuthology.orchestra.console:Power off smithi082 2023-07-21T18:36:40.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:36:40.032 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_17:58:19-fs-wip-rishabh-2023Jul13-m-quota-testing-default-smithi/7346875', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 18:33:33.291852', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-21T18:36:40.040 INFO:teuthology.orchestra.console:Power off smithi088 2023-07-21T18:36:40.041 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:36:40.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:40.065 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:40.096 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-21T18:36:40.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:36:40.111 INFO:teuthology.orchestra.console:Power off smithi157 2023-07-21T18:36:40.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T18:36:40.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:44.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:44.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:44.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:44.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:46.266 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:36:46.268 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:36:56.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:56.285 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi082.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:56.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:56.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:36:56.310 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:36:56.314 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:37:01.322 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:01.435 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2023-07-21T18:37:01.436 INFO:teuthology.orchestra.console:Power off for smithi082 completed 2023-07-21T18:37:01.436 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-07-21T18:37:01.437 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2023-07-21T18:37:01.632 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-07-21T18:37:01.652 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2023-07-21T18:37:01.653 INFO:teuthology.lock.ops:unlocked: smithi082.front.sepia.ceph.com 2023-07-21T18:37:03.218 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-07-21T18:37:06.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:11.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:16.337 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:37:21.345 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:37:21.346 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:37:21.348 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:37:21.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:31.372 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:36.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:41.423 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:37:41.426 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:37:41.439 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:37:41.440 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:37:41.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:46.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:51.820 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:37:56.504 DEBUG:teuthology.provision.fog.smithi157:FOG request: GET /task/active None 2023-07-21T18:37:56.507 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-07-21T18:37:56.508 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-07-21T18:38:01.515 DEBUG:teuthology.provision.fog.smithi082:FOG request: GET /task/active None 2023-07-21T18:38:01.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T18:38:01.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:01.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:01.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:01.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:01.859 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-21T18:38:06.965 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-21T18:38:06.966 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-07-21T18:38:06.967 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-21T18:38:06.967 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-21T18:38:12.015 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com 2023-07-21T18:38:17.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:22.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:27.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:32.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:32.039 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-07-21T18:38:32.040 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-21T18:38:37.168 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-21T18:38:37.169 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-21T18:38:42.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:47.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:52.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:57.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:38:57.323 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-21T18:39:02.428 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-07-21T18:39:07.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:39:12.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T18:39:17.588 WARNING:teuthology.provision.fog.smithi082:[Errno None] Unable to connect to port 22 on 172.21.15.82 2023-07-21T18:39:17.588 WARNING:teuthology.provision.fog.smithi157:[Errno None] Unable to connect to port 22 on 172.21.15.157 2023-07-21T18:39:17.720 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 85, in create self.remote.console.power_on() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/console.py", line 243, in power_on raise RuntimeError(err_msg) RuntimeError: Failed to power on smithi150