2023-07-19T22:40:57.143 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-19T22:40:57.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T22:40:57.145 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T22:41:17.399 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84331e5ee0>, signals=[15]) 2023-07-19T22:41:17.402 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-07-19T22:41:17.402 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T22:41:17.403 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-07-19T22:41:17.433 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-07-19T22:41:17.434 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-07-19T22:41:17.435 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-07-19T22:41:17.436 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /host {"name": "smithi046"} 2023-07-19T22:41:22.466 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-07-19T22:41:32.507 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-19T22:41:45.002 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-19T22:41:49.999 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-19T22:41:50.000 DEBUG:teuthology.provision.fog.smithi046:FOG request: PUT /host/151 {"imageID": 2} 2023-07-19T22:41:50.056 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-19T22:41:50.057 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 2} 2023-07-19T22:41:50.062 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 20.04 2023-07-19T22:41:50.063 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-19T22:41:50.103 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of ubuntu 20.04 2023-07-19T22:41:50.103 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:41:50.146 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T22:41:50.164 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-07-19T22:41:50.183 DEBUG:teuthology.provision.fog.smithi046:FOG request: POST /host/151/task {"taskTypeID": 1} 2023-07-19T22:41:50.199 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-07-19T22:41:50.304 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-19T22:41:50.317 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:42:00.422 INFO:teuthology.orchestra.console:Power off smithi179 2023-07-19T22:42:00.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:42:00.440 INFO:teuthology.orchestra.console:Power off smithi046 2023-07-19T22:42:00.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:42:05.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:05.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:09.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:10.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:14.616 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:15.571 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:19.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:20.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:24.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:25.795 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:29.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:30.164 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-07-19T22:42:30.265 INFO:teuthology.orchestra.console:Power on smithi046 2023-07-19T22:42:30.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T22:42:30.907 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:31.117 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-07-19T22:42:31.219 INFO:teuthology.orchestra.console:Power on smithi179 2023-07-19T22:42:31.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-19T22:42:31.242 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:35.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:35.475 INFO:teuthology.orchestra.console:Power on for smithi179 completed 2023-07-19T22:42:35.576 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-07-19T22:42:35.576 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:42:40.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:45.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:42:45.803 INFO:teuthology.orchestra.console:Power on for smithi046 completed 2023-07-19T22:42:45.904 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-07-19T22:42:45.904 DEBUG:teuthology.provision.fog.smithi046:FOG request: GET /task/active None 2023-07-19T22:42:50.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:42:56.001 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:43:01.009 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-19T22:43:07.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:43:10.100 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-19T22:43:16.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:43:16.107 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:43:19.184 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-19T22:43:25.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:43:31.491 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:43:36.497 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-19T22:43:42.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:43:45.584 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-07-19T22:43:51.588 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:43:51.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:16.692 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-07-19T22:44:21.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:44:26.863 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:44:26.864 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T22:44:26.865 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T22:44:26.866 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:27.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:28.260 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:44:28.261 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-19T22:44:28.261 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-19T22:44:28.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:28.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:29.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:29.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:30.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:30.893 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:31.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:31.901 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:32.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:32.909 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:33.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:33.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:34.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:34.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:35.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:35.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:36.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:36.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:37.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:37.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:38.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:38.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:39.347 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:39.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:40.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:40.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:41.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:41.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:42.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:42.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:43.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:43.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:44.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:45.002 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:45.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:46.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:46.402 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:47.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:47.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:48.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:48.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:49.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:49.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:50.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:50.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:51.054 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:51.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:52.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:52.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:53.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:53.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:54.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:54.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:55.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:55.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:56.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:56.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:57.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:57.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:58.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:58.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:59.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:44:59.506 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:00.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:00.514 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:01.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:01.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:02.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:02.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:03.147 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:03.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:04.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:04.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:05.164 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:05.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:06.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:06.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:07.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:07.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:08.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:08.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:09.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:09.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:10.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:10.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:11.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:11.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:12.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:12.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:13.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:13.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:14.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:14.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:15.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:15.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:16.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:16.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:17.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:17.648 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:18.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:18.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:19.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:19.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:20.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:20.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:21.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:21.678 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:22.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:22.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:23.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:23.696 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:24.312 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:24.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:25.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:25.710 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:26.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:26.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:27.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:27.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:28.342 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:28.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:29.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:29.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:30.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:30.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:31.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:31.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:32.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:32.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:33.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:33.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:34.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:34.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:35.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:35.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:36.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:36.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:37.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:37.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:38.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:38.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:39.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:39.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:40.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:40.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:41.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:41.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:42.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:42.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:43.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:43.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:44.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:44.860 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:45.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:45.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:46.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:46.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:47.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:47.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:48.495 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:48.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:49.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:49.898 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:50.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:50.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:51.517 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:51.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:52.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:52.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:53.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:53.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:54.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:54.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:55.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:55.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:56.555 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:56.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:57.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:57.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:58.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:58.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:59.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:45:59.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:00.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:00.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:01.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:01.993 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:02.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:03.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:03.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:04.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:04.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:05.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:05.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:06.021 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:06.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:07.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:07.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:08.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:08.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:09.042 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:09.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:10.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:10.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:11.056 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:11.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:12.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:12.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:13.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:13.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:14.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:14.679 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:15.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:15.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:16.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:16.691 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:17.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:17.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:18.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:18.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:19.107 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:19.711 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:20.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:20.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:21.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:21.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:22.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:22.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:23.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:23.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:24.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:24.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:25.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:25.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:26.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:26.754 ERROR:teuthology.provision.fog: on smithi179 2023-07-19T22:46:27.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:28.155 ERROR:teuthology.provision.fog: on smithi046 2023-07-19T22:46:35.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-19T22:46:35.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:46:40.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-19T22:46:40.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:46:45.837 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:46:45.837 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-19T22:46:45.838 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:46:45.841 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:46:45.841 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-07-19T22:46:45.842 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:48:49.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-19T22:48:49.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:48:49.891 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:48:49.891 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-19T22:48:49.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:48:54.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-19T22:48:54.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:48:54.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:48:54.891 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-07-19T22:48:54.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:51:01.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-19T22:51:01.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:51:01.907 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:51:01.907 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-19T22:51:01.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:51:06.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-19T22:51:06.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:51:06.902 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:51:06.902 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-07-19T22:51:06.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:53:04.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-07-19T22:53:04.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:53:04.913 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:53:04.914 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-07-19T22:53:04.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:53:09.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-07-19T22:53:09.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-19T22:53:14.918 ERROR:teuthology.orchestra.connection:Error authenticating with smithi046.front.sepia.ceph.com: Authentication failed. 2023-07-19T22:53:14.919 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-07-19T22:53:14.920 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-19T22:55:04.806 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-19T22:55:04.809 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi179 2023-07-19T22:55:04.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-19T22:55:04.811 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-19T22:55:04.900 INFO:teuthology.nuke:Checking targets against current locks 2023-07-19T22:55:04.954 DEBUG:teuthology.nuke:shortname: smithi046 2023-07-19T22:55:04.954 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T22:55:04.977 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:40:49-rbd-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 22:40:56.331103', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-19T22:55:04.982 DEBUG:teuthology.nuke:shortname: smithi179 2023-07-19T22:55:04.982 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-19T22:55:05.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-19_14:40:49-rbd-wip-yuri11-testing-2023-07-18-0927-pacific-distro-default-smithi/7343927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-19 22:40:56.333462', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSAlWjESMc0Gra5f/6dvvbjuYJc2qVK13Ztw1gt4S0hdg9pLl/eAcLsaHQz3OAGEzcbKS0DF4bknjuwe5HHhPE='} 2023-07-19T22:55:05.029 INFO:teuthology.orchestra.console:Power off smithi046 2023-07-19T22:55:05.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:55:05.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:55:05.072 INFO:teuthology.orchestra.console:Power off smithi179 2023-07-19T22:55:05.073 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-19T22:55:05.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:55:09.083 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:55:09.122 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:55:13.196 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:55:13.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-19T22:55:13.409 INFO:teuthology.orchestra.console:Power off for smithi046 completed 2023-07-19T22:55:13.444 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-07-19T22:55:13.571 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-07-19T22:55:13.598 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2023-07-19T22:55:13.867 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi179