2023-07-17T11:17:58.490 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-17T11:17:58.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-17T11:17:58.492 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-17T11:18:13.564 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fee50505820>, signals=[15]) 2023-07-17T11:18:13.566 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-07-17T11:18:13.566 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-07-17T11:18:13.567 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-07-17T11:18:18.592 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-07-17T11:18:28.531 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-17T11:18:33.592 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-17T11:18:33.593 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 5} 2023-07-17T11:18:33.676 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of rhel 8.6 2023-07-17T11:18:33.676 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-17T11:18:33.738 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-07-17T11:18:38.786 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-07-17T11:18:38.858 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-17T11:18:43.954 INFO:teuthology.orchestra.console:Power off smithi031 2023-07-17T11:18:43.955 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-17T11:18:43.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:18:44.095 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2023-07-17T11:18:44.196 INFO:teuthology.orchestra.console:Power on smithi031 2023-07-17T11:18:44.196 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-17T11:18:44.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:18:48.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:18:53.352 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:18:58.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:18:58.673 INFO:teuthology.orchestra.console:Power on for smithi031 completed 2023-07-17T11:18:58.774 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-07-17T11:18:58.775 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-17T11:19:18.852 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-17T11:19:38.919 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-17T11:19:58.984 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-07-17T11:20:04.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-17T11:20:07.088 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-07-17T11:20:13.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-17T11:20:13.208 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-17T11:20:13.210 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-17T11:20:13.211 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-17T11:20:13.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:14.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:15.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:16.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:17.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:18.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:19.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:20.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:21.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:22.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:23.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:24.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:25.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:26.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:27.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:28.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:29.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:30.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:31.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:32.318 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:33.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:34.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:35.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:36.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:37.347 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:38.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:39.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:40.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:41.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:42.375 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:43.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:44.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:45.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:46.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:47.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:48.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:49.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:50.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:51.435 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:52.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:53.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:54.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:55.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:56.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:57.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:58.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:20:59.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:00.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:01.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:02.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:03.522 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:04.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:05.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:06.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:07.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:08.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:09.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:10.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:11.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:12.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:13.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:14.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:15.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:16.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:17.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:18.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:19.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:20.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:21.638 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:22.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:23.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:24.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:25.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:26.669 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:27.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:28.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:29.690 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:30.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:31.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:32.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:33.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:34.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:35.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:36.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:37.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:38.749 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:39.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:40.761 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:41.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:42.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:43.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:44.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:45.799 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:46.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:47.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:48.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:49.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:50.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:51.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:52.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:53.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:54.855 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:55.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:56.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:57.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:58.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:21:59.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:00.893 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:01.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:02.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:03.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:04.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:05.927 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:06.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:07.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:08.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:09.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:10.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:11.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:12.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:22:13.099 ERROR:teuthology.provision.fog: on smithi031 2023-07-17T11:22:22.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-07-17T11:22:22.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-17T11:22:22.223 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-17T11:22:22.226 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-07-17T11:22:22.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:24:31.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-07-17T11:24:31.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-17T11:24:31.233 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-17T11:24:31.233 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-07-17T11:24:31.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:26:43.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-07-17T11:26:43.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-17T11:26:48.259 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-17T11:26:48.259 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-07-17T11:26:48.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:28:51.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-07-17T11:28:51.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-17T11:28:56.269 ERROR:teuthology.orchestra.connection:Error authenticating with smithi031.front.sepia.ceph.com: Authentication failed. 2023-07-17T11:28:56.270 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-07-17T11:28:56.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-17T11:30:56.160 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-17T11:30:56.162 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi031 2023-07-17T11:30:56.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-17T11:30:56.164 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-17T11:31:01.255 INFO:teuthology.nuke:Checking targets against current locks 2023-07-17T11:31:11.318 DEBUG:teuthology.nuke:shortname: smithi031 2023-07-17T11:31:11.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-17T11:31:12.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341263', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-17 11:17:57.747447', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLzQOqQpojpEoQSuqTOmw2Y51lXT4R9wYhUmdt1n/GlgUS3yYMQQFt5Wr3jLVc4vaq5+ZBTzCc06E5NIg7rpHnY8iefgipKZ4EWig05/vHJmJ2H7e04w8zoLWxhpVt+DTAB3y1MUml3/sbxHDRJSvOUhyNNkzmf9zu+xw9ZF0PbS7NMoMJFofEN4eIM5UG0grhJSYIpecKIifGCkHOSdP8o9PGjBShhW/9KFKqQXk61m34ytzh6BGKVHGON7xVV+0tgbCay7zLIi+/TuMj1QMLK/H9o7H2sixw4JvDyERJS6oARqv6KUm3ILoapClpkRhDwTmAaa6wuwO41O2hxf1RM1QVHvBGrMb72QRUsTjga5L6CbzqgjyrfM5qj3H30Rk+ocYK4dVy0F9UgCwsnLFZbUTQ4oZtSwMeGlNbVPlj8rYl8acGZvr2zPVVp4BEEDjbQRbXABoJYvtk7Vu9G3PLD7R+6mKH8Z6n//6iuOO7mApNWUZN1QAOTwQtOPTZnRk='} 2023-07-17T11:31:12.711 INFO:teuthology.orchestra.console:Power off smithi031 2023-07-17T11:31:12.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-17T11:31:12.743 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:31:16.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:31:21.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:31:26.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:31:32.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:31:37.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-17T11:31:37.426 INFO:teuthology.orchestra.console:Power off for smithi031 completed 2023-07-17T11:31:47.582 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com 2023-07-17T11:31:52.719 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi031