2023-07-05T23:43:26.477 INFO:root:teuthology version: 0.0.1.dev142+g312557c 2023-07-05T23:43:26.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-05T23:43:26.479 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-05T23:43:26.689 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f34d44f68b0>, signals=[15]) 2023-07-05T23:43:26.691 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-07-05T23:43:26.691 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T23:43:26.691 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-07-05T23:43:26.715 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging 2023-07-05T23:43:26.716 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T23:43:26.716 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2023-07-05T23:43:26.718 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-07-05T23:43:26.739 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-05T23:43:26.740 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-05T23:43:26.740 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-05T23:43:26.741 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"} 2023-07-05T23:43:26.766 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-05T23:43:26.797 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-05T23:43:26.821 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-05T23:43:26.842 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-05T23:43:26.842 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 5} 2023-07-05T23:43:26.855 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-05T23:43:26.879 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-05T23:43:26.879 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 5} 2023-07-05T23:43:26.903 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.6 2023-07-05T23:43:26.905 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:43:26.908 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-05T23:43:26.908 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-07-05T23:43:26.929 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of rhel 8.6 2023-07-05T23:43:26.929 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:43:26.954 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-07-05T23:43:26.954 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:43:26.962 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T23:43:26.991 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T23:43:27.000 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-07-05T23:43:27.013 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-05T23:43:27.031 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1} 2023-07-05T23:43:27.046 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:43:27.053 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-05T23:43:27.076 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:43:27.120 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:43:27.160 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-05T23:43:27.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T23:43:27.183 INFO:teuthology.orchestra.console:Power off smithi097 2023-07-05T23:43:27.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T23:43:27.195 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:27.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:27.228 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-05T23:43:27.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-05T23:43:27.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:31.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:31.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:31.279 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:35.360 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:35.370 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:35.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:35.572 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-07-05T23:43:35.584 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-05T23:43:35.674 INFO:teuthology.orchestra.console:Power on smithi097 2023-07-05T23:43:35.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T23:43:35.686 INFO:teuthology.orchestra.console:Power on smithi045 2023-07-05T23:43:35.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T23:43:35.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:35.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:39.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:39.721 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-05T23:43:39.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:39.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:39.822 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-05T23:43:39.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-05T23:43:39.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:43.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:43.859 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:43.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-05T23:43:44.056 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2023-07-05T23:43:44.072 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2023-07-05T23:43:44.087 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-05T23:43:44.159 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2023-07-05T23:43:44.159 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:43:44.173 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-07-05T23:43:44.173 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:43:44.189 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-05T23:43:44.189 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:43:59.245 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:43:59.251 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:43:59.253 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:44:14.328 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:44:14.329 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:44:14.330 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:44:29.412 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:44:29.415 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:44:29.416 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:44:44.492 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:44:44.530 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:44:44.532 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:44:59.608 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:44:59.613 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:44:59.621 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:45:14.689 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:45:14.691 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:45:14.691 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:45:29.776 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:45:29.778 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:45:29.781 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:45:44.860 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:45:44.874 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:45:44.877 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:45:59.956 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:45:59.957 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:45:59.960 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:46:15.049 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:46:15.050 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-07-05T23:46:15.051 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:46:15.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:18.192 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-05T23:46:24.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:27.284 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-05T23:46:30.120 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None 2023-07-05T23:46:30.123 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:46:30.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:33.232 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T23:46:33.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:36.340 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-05T23:46:39.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:42.292 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T23:46:42.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:45.180 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-05T23:46:45.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:45.392 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-05T23:46:48.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:48.304 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:46:51.376 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T23:46:51.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:54.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:46:54.452 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-05T23:46:57.360 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:46:57.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:00.437 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T23:47:00.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:03.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:03.504 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-07-05T23:47:06.416 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:47:06.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:09.492 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T23:47:09.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:12.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:15.472 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:47:15.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:18.548 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97 2023-07-05T23:47:21.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:24.528 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:47:24.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:30.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:47:33.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:47:39.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:48:09.536 WARNING:teuthology.provision.fog.smithi045:timed out 2023-07-05T23:48:15.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:48:15.878 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-05T23:48:15.879 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-05T23:48:16.184 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-07-05T23:48:16.184 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-07-05T23:48:16.204 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-07-05T23:48:16.204 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-07-05T23:48:16.264 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-07-05T23:48:16.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-05T23:48:16.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-07-05T23:48:16.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-07-05T23:48:16.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-07-05T23:48:16.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-07-05T23:48:16.646 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-07-05T23:48:16.704 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2023-07-05T23:48:16.704 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2023-07-05T23:48:16.704 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2023-07-05T23:48:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2023-07-05T23:48:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2023-07-05T23:48:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-07-05T23:48:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-07-05T23:48:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-05T23:48:16.707 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-05T23:48:16.707 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-05T23:48:16.707 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-05T23:48:16.708 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-07-05T23:48:16.709 DEBUG:teuthology.parallel:result is None 2023-07-05T23:48:24.554 WARNING:teuthology.provision.fog.smithi097:timed out 2023-07-05T23:48:30.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:48:30.898 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-05T23:48:30.899 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-05T23:48:31.182 INFO:teuthology.provision.fog.smithi097:Node is ready 2023-07-05T23:48:31.182 DEBUG:teuthology.orchestra.run.smithi097:> hostname 2023-07-05T23:48:31.244 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097 2023-07-05T23:48:31.244 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097 /etc/hosts 2023-07-05T23:48:31.306 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2023-07-05T23:48:31.306 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-07-05T23:48:31.410 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097/smithi097/g' /etc/hosts 2023-07-05T23:48:31.438 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts 2023-07-05T23:48:31.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097/smithi097/g' /etc/hostname 2023-07-05T23:48:31.580 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097 2023-07-05T23:48:31.649 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2023-07-05T23:48:31.709 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Red Hat Enterprise Linux" 2023-07-05T23:48:31.709 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="8.6 (Ootpa)" 2023-07-05T23:48:31.709 INFO:teuthology.orchestra.run.smithi097.stdout:ID="rhel" 2023-07-05T23:48:31.709 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="fedora" 2023-07-05T23:48:31.709 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="8.6" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el8" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.redhat.com/" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-05T23:48:31.710 INFO:teuthology.orchestra.run.smithi097.stdout: 2023-07-05T23:48:31.711 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-05T23:48:31.711 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-05T23:48:31.711 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-05T23:48:31.711 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-05T23:48:31.711 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2023-07-05T23:48:31.712 DEBUG:teuthology.parallel:result is None 2023-07-05T23:48:39.596 WARNING:teuthology.provision.fog.smithi140:timed out 2023-07-05T23:48:45.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:03.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:49:09.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:13.040 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:49:19.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:22.100 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:49:28.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:31.188 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:49:37.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:40.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:49:46.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:49.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:49:55.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:49:58.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:04.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:50:07.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:13.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:50:16.500 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:22.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:50:25.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:31.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:50:34.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:40.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:50:43.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:49.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:50:52.784 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:50:58.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:01.844 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:51:07.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:10.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:51:16.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:19.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:51:25.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:29.044 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:51:35.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:38.128 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:51:44.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:47.188 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:51:53.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:51:56.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:02.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:05.360 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:11.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:14.420 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:20.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:23.504 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:29.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:32.560 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:38.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:41.620 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:47.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:50.704 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:52:56.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:52:59.760 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:53:05.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:53:08.816 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:53:14.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:53:17.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:53:23.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:53:26.932 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:53:32.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:53:36.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:53:42.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:53:45.072 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:53:51.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:53:54.132 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:00.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:03.216 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:09.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:12.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:18.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:21.329 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:27.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:30.416 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:36.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:39.504 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:45.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:48.564 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:54:54.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:54:57.648 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:03.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:55:06.708 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:12.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:55:15.792 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:21.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:55:24.848 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:30.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:55:33.904 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:39.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:55:42.960 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:48.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:55:52.016 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:55:58.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:01.072 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:56:07.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:10.128 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:56:16.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:19.184 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:56:25.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:28.240 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:56:34.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:37.300 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:56:43.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:46.388 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:56:52.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:56:55.472 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:01.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:04.528 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:10.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:13.588 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:19.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:22.672 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:28.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:31.732 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:37.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:40.816 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:46.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:49.872 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:57:55.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:57:58.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:04.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:58:07.984 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:13.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:58:17.040 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:23.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:58:26.100 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:32.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:58:35.184 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:41.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:58:44.272 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:50.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:58:53.328 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:58:59.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:02.384 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:59:08.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:11.440 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:59:17.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:20.496 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:59:26.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:29.556 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:59:35.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:38.644 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:59:44.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:47.728 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-05T23:59:53.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-05T23:59:56.784 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:02.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:00:05.840 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:11.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:00:14.896 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:20.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:00:23.952 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:29.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:00:33.008 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:39.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:00:42.064 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:48.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:00:51.152 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:00:57.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:00.208 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:01:06.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:09.264 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:01:15.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:18.324 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:01:24.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:27.412 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:01:33.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:36.500 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:01:42.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:45.584 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:01:51.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:01:54.640 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:00.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:03.696 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:09.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:12.752 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:18.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:21.808 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:27.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:30.864 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:36.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:39.920 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:45.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:48.976 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:54.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T00:02:58.032 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-06T00:02:58.035 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-07-06T00:02:58.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T00:02:58.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-06T00:02:58.122 INFO:teuthology.nuke:Checking targets against current locks 2023-07-06T00:02:58.183 DEBUG:teuthology.nuke:shortname: smithi045 2023-07-06T00:02:58.183 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T00:02:58.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-07-05_23:39:40-smoke-main-distro-default-smithi/7327964', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:43:25.550026', 'locked_by': 'scheduled_zack@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-06T00:02:58.222 DEBUG:teuthology.nuke:shortname: smithi097 2023-07-06T00:02:58.222 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T00:02:58.239 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-06T00:02:58.240 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T00:02:58.247 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-07-05_23:39:40-smoke-main-distro-default-smithi/7327964', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:43:25.547349', 'locked_by': 'scheduled_zack@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8hqGpaqfbU8ZTsa9rS1zFKk2xO49NOiUG5ifQau6u0yvItLsjoj+QzG4UNdECe5rE7iOjDADfyvDLn4S1z4sGBS/vnV1GOpNPia4+h0PkemqRqRzN+WQ1PfMhKr4q04qkRRQtL4N5o9FnQCT/z6JhNZh9w0Vxm4cA0tLNlHJbIYHYFOTRxURFOmYagcBikStIZEynfAjb9h+u591S+iid7lIs2Zrt7s7YiPyuQ9z243oLCngt11knHnQCOHim1NNyvTUdYbsP2a9KTXuXihcV22eAlVvPQh1kBkT63CRldKwinyrrUBWZVOAREuJ7MeGO2VCFsSxuGmCarQ6bTiqVWZULOX4+Fl2AxZa4slAfKX8gcXrddEdvCGabc8MuSFCz5MRHotFdThz/FcEwn7KShj0G0JOp5dHbAgFvFZfEkc3e6SIGnvih9jM7HSCWJ2NYza/W1UZ5HQIYGSOkLluaba+gxL+pC5Ww33B/VxgeGb501yXXUPmE+5TmjxWHXR8='} 2023-07-06T00:02:58.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-07-05_23:39:40-smoke-main-distro-default-smithi/7327964', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 23:43:25.548830', 'locked_by': 'scheduled_zack@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPNZrY8OuO0IhqSXfn6tnU0KMEiETz2jMt0ANj0Bf+/b'} 2023-07-06T00:02:58.277 INFO:teuthology.orchestra.console:Power off smithi045 2023-07-06T00:02:58.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T00:02:58.299 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:02:58.314 INFO:teuthology.orchestra.console:Power off smithi097 2023-07-06T00:02:58.315 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T00:02:58.331 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-06T00:02:58.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-06T00:02:58.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:02:58.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:02.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:02.365 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:02.376 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:06.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:06.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:06.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-06T00:03:06.678 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-07-06T00:03:06.688 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2023-07-06T00:03:06.698 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-06T00:03:06.835 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2023-07-06T00:03:06.842 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2023-07-06T00:03:06.851 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-06T00:03:07.246 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/provision/fog.py", line 276, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_312557c7024679fde737ba4e8f6254fc59266136/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds