2023-07-25T23:50:48.262 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-25T23:50:48.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T23:50:48.264 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T23:51:03.482 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc0d5547df0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc0d4ef3310>, signals=[15])
2023-07-25T23:51:03.483 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-07-25T23:51:03.484 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-07-25T23:51:03.484 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-07-25T23:51:03.548 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2023-07-25T23:51:03.548 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2023-07-25T23:51:03.549 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-07-25T23:51:03.550 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"}
2023-07-25T23:51:08.572 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging
2023-07-25T23:51:08.572 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server
2023-07-25T23:51:08.572 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server
2023-07-25T23:51:08.574 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"}
2023-07-25T23:51:23.542 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"}
2023-07-25T23:51:28.577 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-25T23:51:33.584 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-25T23:51:43.618 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-25T23:51:48.626 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_8.stream (ID 3)
2023-07-25T23:51:48.627 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 3}
2023-07-25T23:51:48.628 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_8.stream (ID 3)
2023-07-25T23:51:48.628 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 3}
2023-07-25T23:51:58.687 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3)
2023-07-25T23:51:58.687 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 3}
2023-07-25T23:52:03.694 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.stream
2023-07-25T23:52:03.694 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-25T23:52:03.695 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream
2023-07-25T23:52:03.696 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-07-25T23:52:08.766 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream
2023-07-25T23:52:08.766 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-07-25T23:52:08.772 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"}
2023-07-25T23:52:08.775 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"}
2023-07-25T23:52:08.808 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1}
2023-07-25T23:52:08.811 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1}
2023-07-25T23:52:08.815 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"}
2023-07-25T23:52:08.852 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1}
2023-07-25T23:52:08.860 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-25T23:52:08.863 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None
2023-07-25T23:52:08.906 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-07-25T23:52:23.970 INFO:teuthology.orchestra.console:Power off smithi086
2023-07-25T23:52:23.971 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T23:52:23.988 INFO:teuthology.orchestra.console:Power off smithi031
2023-07-25T23:52:23.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T23:52:24.004 INFO:teuthology.orchestra.console:Power off smithi173
2023-07-25T23:52:24.005 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T23:52:29.015 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T23:52:29.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:29.033 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T23:52:29.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:29.043 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:52:30.043 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:33.048 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:33.159 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:52:33.999 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T23:52:34.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:34.021 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:52:34.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:35.154 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:37.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:38.023 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:38.271 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:39.132 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:39.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:40.264 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:42.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:43.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:43.383 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:44.243 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:44.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:45.375 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:47.387 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:48.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:48.497 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:49.354 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:49.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:50.486 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:52.498 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:53.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:53.465 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:52:53.566 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-07-25T23:52:53.608 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:53.668 INFO:teuthology.orchestra.console:Power on smithi086
2023-07-25T23:52:53.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-25T23:52:53.689 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-25T23:52:53.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:53.711 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:52:54.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:55.598 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:57.611 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:57.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:52:58.723 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:58.823 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:52:59.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:00.710 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:02.726 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:02.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:03.836 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:03.936 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:04.711 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:05.822 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:07.838 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:07.938 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:08.950 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:09.050 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:09.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:10.935 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:12.951 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:13.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:14.060 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:14.160 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:14.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:15.047 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:53:15.148 INFO:teuthology.orchestra.console:Power off for smithi173 completed
2023-07-25T23:53:15.249 INFO:teuthology.orchestra.console:Power on smithi173
2023-07-25T23:53:15.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-25T23:53:15.271 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-25T23:53:15.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:15.295 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:53:18.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:18.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:19.173 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:19.270 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:19.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:20.404 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:23.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:23.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:24.287 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:24.382 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:24.406 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:25.516 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:28.290 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:28.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:28.401 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:53:28.502 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-07-25T23:53:28.603 INFO:teuthology.orchestra.console:Power on smithi031
2023-07-25T23:53:28.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-25T23:53:28.629 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-25T23:53:28.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:28.662 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:53:29.495 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:29.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:30.628 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:32.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:33.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:33.775 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:34.606 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:34.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:35.739 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:37.776 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:38.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:38.885 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:39.720 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:39.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:40.851 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:42.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:43.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:43.999 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:44.833 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:44.852 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:44.963 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:53:45.064 INFO:teuthology.orchestra.console:Power on for smithi173 completed
2023-07-25T23:53:45.165 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish
2023-07-25T23:53:45.165 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None
2023-07-25T23:53:45.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:53:48.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:48.304 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:53:48.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:49.114 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:49.945 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:53.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:53.227 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:53:53.328 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2023-07-25T23:53:53.429 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-07-25T23:53:53.430 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-25T23:53:53.947 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:53:54.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:53:55.056 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:53:57.360 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:53:59.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:00.172 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:03.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:54:04.175 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:05.284 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:05.285 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-25T23:54:05.285 DEBUG:teuthology.provision.fog.smithi086:Canceling deploy task with ID None
2023-07-25T23:54:05.286 DEBUG:teuthology.provision.fog.smithi086:FOG request: DELETE /task/cancel {"id": None}
2023-07-25T23:54:10.293 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-25T23:54:10.295 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:54:13.847 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi086
2023-07-25T23:54:13.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T23:54:13.849 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T23:54:18.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:54:23.946 INFO:teuthology.nuke:Checking targets against current locks
2023-07-25T23:54:28.953 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-07-25T23:54:28.954 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:54:38.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:54:38.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:54:38.923 DEBUG:teuthology.nuke:shortname: smithi031
2023-07-25T23:54:38.925 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-25T23:54:38.957 DEBUG:teuthology.nuke:shortname: smithi086
2023-07-25T23:54:38.958 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-25T23:54:38.959 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 23:50:44.391367', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-25T23:54:38.982 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 23:50:44.389605', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-25T23:54:38.986 DEBUG:teuthology.nuke:shortname: smithi173
2023-07-25T23:54:38.986 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-25T23:54:39.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_14:29:32-rados-reef-release-distro-default-smithi/7351306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 23:50:44.387319', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-25T23:54:39.028 INFO:teuthology.orchestra.console:Power off smithi031
2023-07-25T23:54:39.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T23:54:39.059 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T23:54:39.060 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:39.084 INFO:teuthology.orchestra.console:Power off smithi086
2023-07-25T23:54:39.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T23:54:39.099 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:54:39.109 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T23:54:39.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:39.129 INFO:teuthology.orchestra.console:Power off smithi173
2023-07-25T23:54:39.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T23:54:39.140 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:54:39.152 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T23:54:39.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:39.178 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T23:54:41.936 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-25T23:54:43.101 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:43.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:43.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:44.212 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:44.254 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:44.290 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:47.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:54:48.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:48.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:48.291 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:48.366 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:54:48.467 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-07-25T23:54:53.572 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-25T23:54:53.573 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:53.573 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T23:54:58.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:58.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T23:54:58.628 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:54:58.655 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com
2023-07-25T23:54:58.730 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:54:58.831 INFO:teuthology.orchestra.console:Power off for smithi173 completed
2023-07-25T23:55:03.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:55:08.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:55:13.945 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T23:55:13.945 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-25T23:55:18.964 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-07-25T23:55:18.965 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:55:18.993 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com
2023-07-25T23:55:23.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:55:28.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:55:33.995 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-25T23:55:39.029 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173
2023-07-25T23:55:39.058 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2023-07-25T23:55:42.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:55:48.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T23:55:53.013 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-07-25T23:55:53.150 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi086