2023-07-21T06:45:34.883 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-21T06:45:34.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T06:45:34.885 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T06:45:35.074 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9b09384640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9b08cf68b0>, signals=[15])
2023-07-21T06:45:35.076 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging
2023-07-21T06:45:35.077 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T06:45:35.077 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-07-21T06:45:35.107 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-07-21T06:45:35.107 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T06:45:35.108 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-07-21T06:45:35.110 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"}
2023-07-21T06:45:35.139 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2023-07-21T06:45:35.140 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T06:45:35.140 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-07-21T06:45:35.141 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"}
2023-07-21T06:45:35.164 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"}
2023-07-21T06:45:35.183 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T06:45:35.215 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T06:45:35.228 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T06:45:35.228 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 10}
2023-07-21T06:45:35.235 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T06:45:35.254 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T06:45:35.254 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 10}
2023-07-21T06:45:35.267 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 9.stream
2023-07-21T06:45:35.268 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:45:35.277 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T06:45:35.277 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 10}
2023-07-21T06:45:35.293 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream
2023-07-21T06:45:35.294 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:45:35.318 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream
2023-07-21T06:45:35.318 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:45:35.347 DEBUG:teuthology.provision.fog.smithi144:Canceling deploy task with ID 400231
2023-07-21T06:45:35.348 DEBUG:teuthology.provision.fog.smithi144:FOG request: DELETE /task/cancel {"id": 400231}
2023-07-21T06:45:35.357 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T06:45:35.388 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T06:45:35.395 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1}
2023-07-21T06:45:35.405 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T06:45:35.426 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1}
2023-07-21T06:45:35.446 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1}
2023-07-21T06:45:35.456 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:45:35.499 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:45:35.514 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:45:35.574 INFO:teuthology.orchestra.console:Power off smithi161
2023-07-21T06:45:35.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T06:45:35.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:35.629 INFO:teuthology.orchestra.console:Power off smithi144
2023-07-21T06:45:35.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T06:45:35.648 INFO:teuthology.orchestra.console:Power off smithi191
2023-07-21T06:45:35.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T06:45:35.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:39.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:39.694 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:44.771 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:44.805 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:48.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:49.883 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:49.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:52.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:54.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:55.031 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:45:56.783 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:00.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:00.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:00.317 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-07-21T06:46:00.419 INFO:teuthology.orchestra.console:Power on smithi161
2023-07-21T06:46:00.419 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T06:46:01.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:05.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:05.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:07.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:09.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:10.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:12.118 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:12.329 INFO:teuthology.orchestra.console:Power off for smithi144 completed
2023-07-21T06:46:12.430 INFO:teuthology.orchestra.console:Power on smithi144
2023-07-21T06:46:12.430 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T06:46:12.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:13.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:15.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:16.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:18.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:20.590 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:21.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:23.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:24.014 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-07-21T06:46:24.115 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-07-21T06:46:24.116 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:46:39.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:39.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:44.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:44.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:49.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:49.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:54.222 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:46:54.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:54.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:46:54.685 INFO:teuthology.orchestra.console:Power on for smithi144 completed
2023-07-21T06:46:54.786 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish
2023-07-21T06:46:54.787 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:46:59.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:00.686 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-21T06:47:00.687 ERROR:teuthology.orchestra.console:Failed to power off smithi191
2023-07-21T06:47:00.688 INFO:teuthology.orchestra.console:Power on smithi191
2023-07-21T06:47:00.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T06:47:09.513 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:47:14.497 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:47:14.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:18.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:22.894 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:28.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:29.556 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:47:34.565 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:47:34.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:40.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:45.201 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:50.140 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:47:50.143 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:47:50.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:47:55.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:48:00.540 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:48:05.215 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:48:05.217 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:48:15.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:48:20.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:48:20.549 INFO:teuthology.orchestra.console:Power on for smithi191 completed
2023-07-21T06:48:20.650 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2023-07-21T06:48:20.651 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:48:30.301 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:48:35.309 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:48:40.714 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:48:55.382 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-07-21T06:48:55.384 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-21T06:49:05.389 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:49:10.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:15.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:18.480 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T06:49:24.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:30.494 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:49:35.501 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T06:49:41.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:44.560 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-07-21T06:49:49.936 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-21T06:49:50.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:50.576 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T06:49:50.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:53.712 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:49:55.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:49:59.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:50:02.768 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:50:08.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:50:16.848 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:50:22.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:50:30.928 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:50:36.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:50:45.012 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:50:50.568 WARNING:teuthology.provision.fog.smithi161:timed out
2023-07-21T06:50:51.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:50:56.017 WARNING:teuthology.provision.fog.smithi144:timed out
2023-07-21T06:50:56.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:50:56.760 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T06:50:56.761 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T06:50:57.091 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-07-21T06:50:57.091 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-07-21T06:50:57.106 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-07-21T06:50:57.107 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-07-21T06:50:57.162 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-07-21T06:50:57.163 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-07-21T06:50:57.276 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-07-21T06:50:57.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-07-21T06:50:57.375 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-07-21T06:50:57.443 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-07-21T06:50:57.509 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-07-21T06:50:57.564 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-07-21T06:50:57.564 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9"
2023-07-21T06:50:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-07-21T06:50:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-07-21T06:50:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9"
2023-07-21T06:50:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9"
2023-07-21T06:50:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T06:50:57.565 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-07-21T06:50:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon"
2023-07-21T06:50:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T06:50:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-07-21T06:50:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T06:50:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T06:50:57.566 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T06:50:57.567 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-07-21T06:50:57.569 DEBUG:teuthology.parallel:result is None
2023-07-21T06:51:02.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:51:07.198 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T06:51:07.198 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T06:51:07.484 INFO:teuthology.provision.fog.smithi144:Node is ready
2023-07-21T06:51:07.485 DEBUG:teuthology.orchestra.run.smithi144:> hostname
2023-07-21T06:51:07.499 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com
2023-07-21T06:51:07.500 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts
2023-07-21T06:51:07.555 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144
2023-07-21T06:51:07.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-07-21T06:51:07.691 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts
2023-07-21T06:51:07.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts
2023-07-21T06:51:07.785 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname
2023-07-21T06:51:07.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-07-21T06:51:07.918 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-07-21T06:51:07.972 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T06:51:07.973 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2023-07-21T06:51:07.974 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon"
2023-07-21T06:51:07.974 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T06:51:07.974 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/"
2023-07-21T06:51:07.974 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T06:51:07.974 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T06:51:07.974 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T06:51:07.975 INFO:teuthology.provision.fog.smithi144:Deploy complete!
2023-07-21T06:51:07.975 DEBUG:teuthology.parallel:result is None
2023-07-21T06:51:14.416 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:51:20.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:51:23.504 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T06:51:29.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T06:51:34.865 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T06:51:34.866 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T06:51:50.311 INFO:teuthology.provision.fog.smithi191:Node is ready
2023-07-21T06:51:50.311 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2023-07-21T06:51:50.369 INFO:teuthology.orchestra.run.smithi191.stdout:smithi197
2023-07-21T06:51:50.370 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi197 /etc/hosts
2023-07-21T06:51:50.428 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2023-07-21T06:51:50.428 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-07-21T06:51:50.552 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi197/smithi191/g' /etc/hosts
2023-07-21T06:51:50.583 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.197/172.21.15.191/g' /etc/hosts
2023-07-21T06:51:50.653 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi197/smithi191/g' /etc/hostname
2023-07-21T06:51:50.724 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-07-21T06:51:50.793 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-07-21T06:51:50.849 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2023-07-21T06:51:50.850 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9"
2023-07-21T06:51:50.850 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2023-07-21T06:51:50.850 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2023-07-21T06:51:50.851 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9"
2023-07-21T06:51:50.851 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9"
2023-07-21T06:51:50.851 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-21T06:51:50.852 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-07-21T06:51:50.852 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon"
2023-07-21T06:51:50.852 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-21T06:51:50.853 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2023-07-21T06:51:50.853 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T06:51:50.853 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-21T06:51:50.854 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T06:51:50.854 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2023-07-21T06:51:50.855 DEBUG:teuthology.parallel:result is None
2023-07-21T06:52:34.040 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:52:34.041 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:52:55.056 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:53:22.086 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:53:22.087 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:54:55.199 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:54:55.200 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:55:59.254 ERROR:teuthology.misc:write (smithi144.front.sepia.ceph.com): No route to host
2023-07-21T06:56:15.277 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/misc.py", line 1107, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi144.front.sepia.ceph.com' reached maximum tries (16) after waiting for 120 seconds
2023-07-21T06:56:15.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T06:56:15.278 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T06:56:16.433 INFO:teuthology.nuke:Checking targets against current locks
2023-07-21T06:56:16.484 DEBUG:teuthology.nuke:shortname: smithi144
2023-07-21T06:56:16.485 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T06:56:16.504 DEBUG:teuthology.nuke:shortname: smithi161
2023-07-21T06:56:16.504 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T06:56:16.507 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346389', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 06:56:11.365198', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHU7Ye7jFIt7sOK3UJDv6fBOOOBANDL3003t9iy4k3nlLqG5mF6u1ApAGO5S45c81dntuAUw/YJWbg9QGOZnF7g='}
2023-07-21T06:56:16.518 DEBUG:teuthology.nuke:shortname: smithi191
2023-07-21T06:56:16.518 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T06:56:16.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 06:45:23.996760', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPYdfvp8sdKU1aEADMJQ3YKWq9EcmhnZx5+H5hBmBY1d8Ti4GrER1gdXO+ByBAg1j3kxlLpmXupCAy3Fo2lVpCo='}
2023-07-21T06:56:16.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-21_06:30:09-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7346378', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 06:45:23.995490', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-21T06:56:16.555 INFO:teuthology.orchestra.console:Power off smithi144
2023-07-21T06:56:16.556 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T06:56:16.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:16.594 INFO:teuthology.orchestra.console:Power off smithi161
2023-07-21T06:56:16.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T06:56:16.611 INFO:teuthology.orchestra.console:Power off smithi191
2023-07-21T06:56:16.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T06:56:16.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:16.634 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:16.720 INFO:teuthology.orchestra.console:Power off for smithi144 completed
2023-07-21T06:56:16.880 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com
2023-07-21T06:56:20.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:20.657 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:25.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:25.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:30.871 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:30.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:35.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:35.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:41.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:41.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:46.208 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:46.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:51.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:51.334 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:56.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:56.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T06:56:56.649 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-07-21T06:57:06.787 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2023-07-21T06:57:06.819 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com
2023-07-21T06:57:13.619 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com
2023-07-21T06:57:28.879 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/misc.py", line 1107, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi144.front.sepia.ceph.com' reached maximum tries (16) after waiting for 120 seconds