2023-07-09T04:16:35.879 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T04:16:35.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:16:35.880 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:16:36.095 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc376c79820>, signals=[15]) 2023-07-09T04:16:36.097 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-09T04:16:36.097 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T04:16:36.097 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-09T04:16:36.126 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-07-09T04:16:36.128 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T04:16:36.129 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-07-09T04:16:36.130 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-09T04:16:36.163 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging 2023-07-09T04:16:36.163 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T04:16:36.164 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server 2023-07-09T04:16:36.165 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-07-09T04:16:36.194 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /host {"name": "smithi202"} 2023-07-09T04:16:36.217 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T04:16:36.238 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T04:16:36.263 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T04:16:36.264 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-07-09T04:16:36.269 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-09T04:16:36.275 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T04:16:36.275 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 5} 2023-07-09T04:16:36.314 DEBUG:teuthology.provision.fog.smithi202:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-09T04:16:36.314 DEBUG:teuthology.provision.fog.smithi202:FOG request: PUT /host/306 {"imageID": 5} 2023-07-09T04:16:36.318 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-07-09T04:16:36.319 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:16:36.323 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of rhel 8.6 2023-07-09T04:16:36.323 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:16:36.360 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of rhel 8.6 2023-07-09T04:16:36.360 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:16:36.369 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T04:16:36.370 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T04:16:36.403 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T04:16:36.406 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-09T04:16:36.408 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-07-09T04:16:36.453 DEBUG:teuthology.provision.fog.smithi202:FOG request: POST /host/306/task {"taskTypeID": 1} 2023-07-09T04:16:36.460 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:16:36.466 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:16:36.500 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:16:36.544 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-09T04:16:36.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:16:36.565 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-09T04:16:36.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:16:36.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:36.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:36.608 INFO:teuthology.orchestra.console:Power off smithi202 2023-07-09T04:16:36.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:16:36.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:36.699 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-09T04:16:36.800 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-09T04:16:36.801 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T04:16:36.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:40.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:40.663 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:40.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:44.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:44.774 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:44.956 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-09T04:16:44.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:44.988 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-07-09T04:16:45.058 INFO:teuthology.orchestra.console:Power on smithi159 2023-07-09T04:16:45.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T04:16:45.090 INFO:teuthology.orchestra.console:Power on smithi202 2023-07-09T04:16:45.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T04:16:45.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:45.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:45.285 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-09T04:16:45.386 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-09T04:16:45.386 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:16:49.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:49.162 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:53.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:53.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:16:53.471 INFO:teuthology.orchestra.console:Power on for smithi159 completed 2023-07-09T04:16:53.490 INFO:teuthology.orchestra.console:Power on for smithi202 completed 2023-07-09T04:16:53.574 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-07-09T04:16:53.574 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:16:53.592 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish 2023-07-09T04:16:53.592 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:17:00.448 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:17:08.636 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:17:08.650 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:17:15.514 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:17:23.704 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:17:23.716 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:17:30.585 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:17:38.772 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:17:38.777 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:17:45.648 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:17:53.836 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:17:53.839 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:18:00.720 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:18:08.900 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:18:08.901 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:18:15.800 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:18:23.972 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:18:23.973 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:18:30.876 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:18:39.040 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:18:39.041 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:18:45.944 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:18:54.112 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:18:54.114 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:19:01.036 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:19:09.200 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:19:09.202 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:19:16.120 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:19:24.288 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:19:24.290 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:19:31.205 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-09T04:19:31.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:34.352 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:19:39.380 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-07-09T04:19:39.383 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None 2023-07-09T04:19:39.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:39.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:40.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:42.516 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:19:42.517 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-09T04:19:43.408 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:19:48.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:48.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:49.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:51.600 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:19:51.601 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-09T04:19:52.464 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:19:57.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:57.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:19:58.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:00.660 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:20:00.688 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-09T04:20:01.520 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:20:06.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:06.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:07.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:09.744 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:20:09.745 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-09T04:20:10.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:20:15.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:15.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:16.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:18.800 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:20:18.832 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202 2023-07-09T04:20:19.632 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:20:24.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:24.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:25.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:27.860 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:20:28.688 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:20:33.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:34.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:36.944 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-07-09T04:20:42.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:20:53.232 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:20:59.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:02.288 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:21:08.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:11.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:21:17.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:20.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:21:24.840 WARNING:teuthology.provision.fog.smithi202:timed out 2023-07-09T04:21:26.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:29.456 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:21:30.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:31.199 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T04:21:31.200 DEBUG:teuthology.orchestra.run.smithi202:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T04:21:31.523 INFO:teuthology.provision.fog.smithi202:Node is ready 2023-07-09T04:21:31.523 DEBUG:teuthology.orchestra.run.smithi202:> hostname 2023-07-09T04:21:31.543 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com 2023-07-09T04:21:31.544 DEBUG:teuthology.orchestra.run.smithi202:> grep smithi202.front.sepia.ceph.com /etc/hosts 2023-07-09T04:21:31.605 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202 2023-07-09T04:21:31.605 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202 2023-07-09T04:21:31.731 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hosts 2023-07-09T04:21:31.764 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/172.21.15.202/172.21.15.202/g' /etc/hosts 2023-07-09T04:21:31.836 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hostname 2023-07-09T04:21:31.909 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202 2023-07-09T04:21:31.982 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release 2023-07-09T04:21:32.042 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T04:21:32.043 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T04:21:32.043 INFO:teuthology.orchestra.run.smithi202.stdout:ID="rhel" 2023-07-09T04:21:32.043 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="fedora" 2023-07-09T04:21:32.043 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8.6" 2023-07-09T04:21:32.043 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T04:21:32.044 INFO:teuthology.orchestra.run.smithi202.stdout: 2023-07-09T04:21:32.045 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T04:21:32.045 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T04:21:32.045 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T04:21:32.045 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T04:21:32.046 INFO:teuthology.provision.fog.smithi202:Deploy complete! 2023-07-09T04:21:32.047 DEBUG:teuthology.parallel:result is None 2023-07-09T04:21:35.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:38.512 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:21:42.952 WARNING:teuthology.provision.fog.smithi159:timed out 2023-07-09T04:21:44.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:47.572 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:21:48.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:49.313 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T04:21:49.313 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T04:21:49.577 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-07-09T04:21:49.577 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-07-09T04:21:49.635 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159 2023-07-09T04:21:49.635 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159 /etc/hosts 2023-07-09T04:21:49.693 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-07-09T04:21:49.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-09T04:21:49.823 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159/smithi159/g' /etc/hosts 2023-07-09T04:21:49.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-07-09T04:21:49.918 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159/smithi159/g' /etc/hostname 2023-07-09T04:21:49.985 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-07-09T04:21:50.051 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-07-09T04:21:50.107 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Red Hat Enterprise Linux" 2023-07-09T04:21:50.108 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8.6 (Ootpa)" 2023-07-09T04:21:50.108 INFO:teuthology.orchestra.run.smithi159.stdout:ID="rhel" 2023-07-09T04:21:50.108 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="fedora" 2023-07-09T04:21:50.108 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8.6" 2023-07-09T04:21:50.108 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.redhat.com/" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-09T04:21:50.109 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-07-09T04:21:50.110 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-09T04:21:50.110 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-09T04:21:50.110 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-09T04:21:50.110 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-09T04:21:50.110 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-07-09T04:21:50.111 DEBUG:teuthology.parallel:result is None 2023-07-09T04:21:53.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:21:56.660 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:02.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:22:05.748 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:11.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:22:14.832 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:20.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:22:23.892 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:29.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:22:32.976 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:38.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:22:42.036 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:48.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:22:51.120 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:22:57.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:00.176 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:23:06.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:09.236 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:23:15.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:18.320 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:23:24.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:27.376 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:23:33.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:36.436 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:23:42.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:45.520 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:23:51.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:23:54.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:00.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:03.632 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:09.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:12.692 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:18.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:21.776 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:27.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:30.832 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:36.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:39.924 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:45.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:49.008 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:24:55.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:24:58.064 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:04.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:25:07.120 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:13.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:25:16.176 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:22.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:25:25.264 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:31.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:25:34.320 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:40.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:25:43.376 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:49.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:25:52.432 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:25:58.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:01.492 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:26:07.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:10.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:26:16.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:19.632 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:26:25.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:28.688 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:26:34.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:37.776 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:26:43.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:46.832 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:26:52.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:26:55.888 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:01.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:04.944 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:10.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:14.000 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:20.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:23.056 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:29.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:32.112 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:38.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:41.168 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:47.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:50.256 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:27:56.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:27:59.344 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:05.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:28:08.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:14.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:28:17.456 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:23.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:28:26.512 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:32.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:28:35.568 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:41.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:28:44.628 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:50.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:28:53.712 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:28:59.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:02.768 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:29:08.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:11.824 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:29:17.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:20.880 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:29:26.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:29.940 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:29:35.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:39.024 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:29:45.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:48.084 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:29:54.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:29:57.168 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:03.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:30:06.224 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:12.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:30:15.312 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:21.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:30:24.400 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:30.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:30:33.460 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:39.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:30:42.544 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:48.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:30:51.600 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:30:57.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:00.660 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:31:06.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:09.744 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:31:15.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:18.800 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:31:24.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:27.860 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:31:33.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:36.944 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:31:42.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:46.000 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:31:52.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:31:55.060 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:01.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:04.148 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:10.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:13.232 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:19.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:22.292 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:28.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:31.380 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:37.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:40.464 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:46.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:49.520 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:32:55.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:32:58.576 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:04.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:33:07.632 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:13.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:33:16.688 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:22.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:33:25.744 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:31.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:33:34.800 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:40.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:33:43.856 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:49.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:33:52.916 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:33:58.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:34:02.000 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:34:08.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:34:11.060 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:34:17.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:34:20.144 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:34:26.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:34:29.200 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:34:35.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:34:38.256 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:34:44.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T04:34:47.312 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-09T04:34:47.316 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-07-09T04:34:47.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T04:34:47.318 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T04:34:47.408 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T04:34:47.478 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-09T04:34:47.479 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T04:34:47.511 DEBUG:teuthology.nuke:shortname: smithi159 2023-07-09T04:34:47.511 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T04:34:47.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 04:16:34.926915', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJa7/8OhVS7+9D4S7hUKt9xhCc+EWdeqgC64iZPhEQsQCftTXNZEk7xd2EPauE9tUvXCWCjcpi1uiOiAhniz5dhK3EynMPwRMEMYPMY9ndAB1s9EIOmBlxt0vZAMFJpMHiZRGHywToTL0S8SB3LhT5msymTGioloYMQlomSRRA9Dx1mx1Ia25RQZ8bQGMFcGDO4ymNCzYA3BLfLxJHD2G7TsGcbt5P98TB9Ey7igvc9tE0b6eag7x4FFbYhyNKVHwEj1iX+Vm3ATSb+6DQ4fMPQrMax+rLHeChS44FlEMBE4Q44rH+yTvJHt64yl8Thxl1UTY8HPgNLZXHrawDthFWKkvptl9r6E8uz17Cnwxh7eAI6JJf4G8n2P2LRIvuwpGIIL1m817a1BgoBrPiop1AWmxcyZHEWBs6XInsog2kRn7PSiSjQAgce8YZR1tImL2chqwm++HkVrb0jpbXzHxnhurieI4Ah2B+FJ/8Xyde5GLikAKZCZTKCxL/V4C7eAE='} 2023-07-09T04:34:47.536 DEBUG:teuthology.nuke:shortname: smithi202 2023-07-09T04:34:47.536 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T04:34:47.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 04:16:34.930245', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-09T04:34:47.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi202.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-08_23:33:40-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 04:16:34.928672', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T04:34:47.575 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-09T04:34:47.576 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:34:47.601 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:47.622 INFO:teuthology.orchestra.console:Power off smithi159 2023-07-09T04:34:47.623 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:34:47.645 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:47.665 INFO:teuthology.orchestra.console:Power off smithi202 2023-07-09T04:34:47.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T04:34:47.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:51.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:51.676 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:51.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:55.768 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:55.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:55.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:34:56.000 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-07-09T04:34:56.057 INFO:teuthology.orchestra.console:Power off for smithi202 completed 2023-07-09T04:34:56.173 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com 2023-07-09T04:34:56.213 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com 2023-07-09T04:34:59.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T04:35:00.090 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-09T04:35:00.238 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-09T04:35:00.684 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds