2023-07-27T05:20:09.606 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T05:20:09.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T05:20:09.608 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T05:20:14.792 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f19db4641f0>, signals=[15]) 2023-07-27T05:20:14.794 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-07-27T05:20:14.794 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T05:20:14.795 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-07-27T05:20:14.817 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-07-27T05:20:14.818 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T05:20:14.818 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-07-27T05:20:14.819 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-07-27T05:20:29.858 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"} 2023-07-27T05:20:39.894 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T05:20:44.939 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T05:20:44.940 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 3} 2023-07-27T05:20:44.969 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T05:20:44.992 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2023-07-27T05:20:44.992 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:20:45.014 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T05:20:45.015 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 3} 2023-07-27T05:20:45.063 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2023-07-27T05:20:45.064 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:20:45.076 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T05:20:45.111 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-07-27T05:20:45.155 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T05:20:45.194 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1} 2023-07-27T05:20:45.264 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:20:45.275 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:20:46.037 INFO:teuthology.orchestra.console:Power off smithi125 2023-07-27T05:20:46.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T05:20:46.053 INFO:teuthology.orchestra.console:Power off smithi181 2023-07-27T05:20:46.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T05:20:46.065 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T05:20:46.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:46.078 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T05:20:46.079 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:46.090 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:20:46.103 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:20:50.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:50.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:50.208 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:20:50.215 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:20:54.212 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:54.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:54.323 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T05:20:54.331 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:20:54.425 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-07-27T05:20:54.525 INFO:teuthology.orchestra.console:Power on smithi125 2023-07-27T05:20:54.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T05:20:58.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:58.441 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T05:20:58.542 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-07-27T05:20:58.643 INFO:teuthology.orchestra.console:Power on smithi181 2023-07-27T05:20:58.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T05:20:58.664 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T05:20:58.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:20:58.686 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T05:20:59.550 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T05:20:59.551 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:21:00.560 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T05:21:02.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:21:02.799 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:21:02.900 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2023-07-27T05:21:03.001 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-07-27T05:21:03.002 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:21:08.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:21:08.119 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:21:08.220 INFO:teuthology.orchestra.console:Power on for smithi125 completed 2023-07-27T05:21:08.321 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-07-27T05:21:08.321 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:21:23.112 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:21:28.420 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:21:38.208 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:21:48.524 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:21:55.798 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:22:08.616 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:22:15.882 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:22:28.696 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-07-27T05:22:29.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:22:32.116 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-07-27T05:22:35.988 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None 2023-07-27T05:22:37.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:22:37.960 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-07-27T05:22:38.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:22:41.204 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-07-27T05:22:43.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:22:44.082 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:22:44.083 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T05:22:44.084 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T05:22:44.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:45.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:46.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:47.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:47.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:22:47.323 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:22:47.324 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T05:22:47.324 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T05:22:47.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:48.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:48.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:49.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:49.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:50.142 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:50.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:51.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:51.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:52.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:52.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:53.173 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:53.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:54.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:54.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:55.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:55.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:56.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:56.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:57.213 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:57.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:58.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:58.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:59.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:22:59.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:00.244 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:00.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:01.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:01.469 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:02.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:02.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:03.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:03.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:04.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:04.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:05.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:05.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:06.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:06.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:07.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:07.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:08.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:08.540 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:09.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:09.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:10.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:10.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:11.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:11.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:12.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:12.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:13.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:13.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:14.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:14.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:15.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:15.612 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:16.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:16.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:17.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:17.629 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:18.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:18.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:19.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:19.652 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:20.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:20.663 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:21.464 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:21.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:22.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:22.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:23.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:23.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:24.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:24.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:25.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:25.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:26.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:26.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:27.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:27.734 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:28.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:28.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:29.540 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:29.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:30.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:30.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:31.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:31.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:32.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:32.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:33.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:33.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:34.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:34.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:35.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:35.811 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:36.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:36.819 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:37.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:37.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:38.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:38.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:39.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:39.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:40.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:40.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:41.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:41.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:42.665 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:42.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:43.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:43.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:44.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:44.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:45.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:45.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:46.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:46.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:47.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:47.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:48.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:48.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:49.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:49.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:50.738 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:50.947 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:51.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:51.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:52.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:52.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:53.766 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:53.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:54.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:54.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:55.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:55.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:56.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:57.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:57.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:58.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:58.815 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:59.023 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:23:59.825 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:00.033 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:00.836 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:01.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:01.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:02.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:02.855 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:03.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:03.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:04.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:04.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:05.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:05.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:06.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:06.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:07.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:07.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:08.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:08.908 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:09.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:09.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:10.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:10.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:11.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:11.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:12.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:12.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:13.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:13.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:14.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:14.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:15.177 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:15.973 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:16.187 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:16.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:17.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:17.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:18.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:19.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:19.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:20.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:20.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:21.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:21.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:22.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:22.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:23.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:23.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:24.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:24.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:25.055 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:25.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:26.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:26.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:27.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:27.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:28.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:28.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:29.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:29.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:30.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:30.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:31.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:31.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:32.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:32.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:33.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:33.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:34.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:34.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:35.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:35.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:36.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:36.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:37.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:37.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:38.185 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:38.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:39.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:39.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:40.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:40.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:41.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:41.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:42.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:42.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:43.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:43.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:43.973 ERROR:teuthology.provision.fog: on smithi181 2023-07-27T05:24:44.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:45.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:46.470 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:24:47.216 ERROR:teuthology.provision.fog: on smithi125 2023-07-27T05:24:52.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-07-27T05:24:52.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:24:57.985 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-07-27T05:24:57.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:25:03.061 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:25:03.062 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-07-27T05:25:03.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:25:03.107 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:25:03.107 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-07-27T05:25:03.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:27:06.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-07-27T05:27:06.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:27:12.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-07-27T05:27:12.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:27:17.077 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:27:17.078 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-07-27T05:27:17.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:27:17.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:27:17.084 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-07-27T05:27:17.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:29:24.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-07-27T05:29:24.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:29:29.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-07-27T05:29:29.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:29:34.096 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:29:34.096 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-07-27T05:29:34.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:29:34.101 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:29:34.101 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-07-27T05:29:34.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:31:32.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-07-27T05:31:32.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:31:32.147 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:31:32.148 DEBUG:teuthology.orchestra.run.smithi181:> true 2023-07-27T05:31:32.149 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:31:37.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-07-27T05:31:37.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T05:31:42.152 ERROR:teuthology.orchestra.connection:Error authenticating with smithi125.front.sepia.ceph.com: Authentication failed. 2023-07-27T05:31:42.153 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-07-27T05:31:42.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T05:33:32.038 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-27T05:33:32.042 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi181 2023-07-27T05:33:32.042 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T05:33:32.043 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T05:33:37.127 INFO:teuthology.nuke:Checking targets against current locks 2023-07-27T05:33:42.132 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-27T05:33:47.213 DEBUG:teuthology.nuke:shortname: smithi125 2023-07-27T05:33:47.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T05:33:47.242 DEBUG:teuthology.nuke:shortname: smithi181 2023-07-27T05:33:47.243 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T05:33:47.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 05:20:08.763724', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-27T05:33:47.265 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353583', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 05:20:08.765661', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwIexk07LfCMYANQs4Bwf58rDDD1r5CcwbQwBaLtV0O5ANYxP75n6hzZkChE7imyJsJ+2yBFgHg6/f2eG/76ycZq8TIZP7wk+OBJ4ItbBpjcF3JGjCZSyUccVNAkO7hZ6WQ5G54vEV56BjKdLKBNEs2TGZzdcb/iKyAxizQuiy8m6OH6qX8JJSgLctTM5aub321SUH6TWrgnbcKea2gGRoXK0j4qtMORCcf0irFu+EHUxkGn2Qx3hS12jBjntamn94PP6OZeMJoqyf+hBtySnrw0PzWUJFPMulQ7RjT3/VCdFp2jLdpY14rWtB0xlQ1bHp0YjZ08jfCYQIzu5diBG3/FBgnNJxr7VTWFKG2IRUKG5jDjG23OhFP4GPIw7X8CAslixhYtrnO4tYz9taV8AWMwZNXLlfYkFyCYrKNZ2gFOAe9xAEKQxFfHJ+ae3QfhrtR9LggvRw5UCR1wh4Fvl7O9l6A9zof/j8NJ0nLRgqCurWOxn4wJMZVo9XUV3pfFE='} 2023-07-27T05:33:47.301 INFO:teuthology.orchestra.console:Power off smithi125 2023-07-27T05:33:47.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T05:33:47.330 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T05:33:47.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:33:47.352 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:33:47.367 INFO:teuthology.orchestra.console:Power off smithi181 2023-07-27T05:33:47.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T05:33:47.388 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T05:33:47.388 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:33:47.410 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:33:51.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:33:51.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:33:51.465 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:33:51.523 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T05:33:55.468 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:33:55.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T05:33:55.577 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T05:33:55.633 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T05:33:55.679 INFO:teuthology.orchestra.console:Power off for smithi125 completed 2023-07-27T05:33:55.734 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-07-27T05:33:55.833 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com 2023-07-27T05:33:55.883 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com 2023-07-27T05:33:56.088 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi181