2023-07-09T12:26:22.561 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T12:26:22.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T12:26:22.563 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T12:26:42.270 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f91be38b790>, signals=[15]) 2023-07-09T12:26:42.272 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-07-09T12:26:42.272 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T12:26:42.273 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-09T12:26:47.311 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-07-09T12:26:47.311 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-07-09T12:26:47.311 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-07-09T12:26:47.313 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-07-09T12:26:57.344 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-07-09T12:27:12.389 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-09T12:27:17.412 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-09T12:27:17.412 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 2} 2023-07-09T12:27:22.443 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-09T12:27:25.345 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of ubuntu 20.04 2023-07-09T12:27:25.346 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:27:30.392 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-09T12:27:30.392 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 2} 2023-07-09T12:27:30.411 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T12:27:30.445 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-07-09T12:27:30.448 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of ubuntu 20.04 2023-07-09T12:27:30.448 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-09T12:27:30.485 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-07-09T12:27:30.493 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:27:30.530 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-07-09T12:27:35.542 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-09T12:27:40.581 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-09T12:27:40.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T12:27:45.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:45.652 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-09T12:27:45.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T12:27:45.675 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:49.700 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:50.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:54.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:54.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:54.953 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-09T12:27:55.054 INFO:teuthology.orchestra.console:Power on smithi079 2023-07-09T12:27:55.054 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T12:27:55.076 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:27:59.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:00.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:05.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:05.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:05.253 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-09T12:28:05.355 INFO:teuthology.orchestra.console:Power on smithi172 2023-07-09T12:28:05.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-09T12:28:05.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:05.409 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2023-07-09T12:28:05.510 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-07-09T12:28:05.511 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:28:09.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:13.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:28:13.730 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-07-09T12:28:13.831 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-07-09T12:28:13.831 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-07-09T12:28:13.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:28:16.944 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:28:20.576 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:28:22.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:28:26.004 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:28:32.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:28:35.088 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:28:35.629 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:28:41.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:28:44.144 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:28:50.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:28:53.200 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:28:55.705 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:28:59.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:29:07.280 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:29:10.768 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:29:15.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:29:18.832 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:29:24.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:29:30.838 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:29:48.272 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-07-09T12:29:50.901 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-09T12:29:54.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:29:54.206 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:29:54.207 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T12:29:54.208 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T12:29:54.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:54.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:29:54.350 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:29:54.350 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-09T12:29:54.351 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-09T12:29:54.351 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:55.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:55.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:56.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:56.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:57.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:57.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:58.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:58.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:59.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:29:59.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:00.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:00.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:01.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:01.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:02.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:02.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:03.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:03.427 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:04.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:04.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:05.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:05.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:06.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:06.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:07.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:07.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:08.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:08.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:09.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:09.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:10.351 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:10.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:11.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:11.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:12.369 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:12.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:13.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:13.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:14.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:14.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:15.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:15.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:16.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:16.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:17.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:17.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:18.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:18.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:19.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:19.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:20.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:20.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:21.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:21.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:22.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:22.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:23.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:23.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:24.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:24.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:25.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:25.628 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:26.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:26.637 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:27.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:27.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:28.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:28.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:29.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:29.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:30.527 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:30.672 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:31.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:31.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:32.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:32.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:33.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:33.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:34.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:34.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:35.569 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:35.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:36.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:36.721 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:37.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:37.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:38.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:38.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:39.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:39.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:40.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:40.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:41.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:41.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:42.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:42.770 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:43.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:43.778 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:44.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:44.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:45.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:45.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:46.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:46.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:47.667 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:47.811 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:48.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:48.819 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:49.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:49.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:50.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:50.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:51.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:51.845 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:52.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:52.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:53.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:53.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:54.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:54.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:55.735 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:55.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:56.743 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:56.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:57.751 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:57.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:58.759 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:58.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:59.767 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:30:59.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:00.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:00.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:01.784 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:01.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:02.792 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:02.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:03.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:03.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:04.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:04.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:05.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:05.967 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:06.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:06.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:07.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:07.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:08.847 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:08.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:09.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:10.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:10.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:11.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:11.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:12.021 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:12.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:13.032 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:13.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:14.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:14.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:15.050 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:15.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:16.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:16.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:17.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:17.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:18.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:18.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:19.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:19.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:20.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:20.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:21.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:21.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:22.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:22.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:23.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:23.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:24.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:24.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:25.136 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:25.997 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:26.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:27.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:27.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:28.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:28.158 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:29.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:29.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:30.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:30.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:31.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:31.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:32.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:32.190 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:33.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:33.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:34.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:34.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:35.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:35.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:36.078 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:36.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:37.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:37.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:38.095 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:38.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:39.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:39.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:40.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:40.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:41.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:41.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:42.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:42.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:43.143 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:43.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:44.152 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:44.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:45.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:45.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:46.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:46.318 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:47.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:47.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:48.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:48.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:49.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:49.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:50.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:50.356 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:51.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:51.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:52.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:52.375 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:53.241 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:53.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:31:54.133 ERROR:teuthology.provision.fog: on smithi079 2023-07-09T12:31:54.279 ERROR:teuthology.provision.fog: on smithi172 2023-07-09T12:32:03.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-09T12:32:03.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:32:03.220 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:32:03.220 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-07-09T12:32:03.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:32:03.281 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-09T12:32:03.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:32:03.397 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:32:03.397 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-09T12:32:03.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:34:12.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-09T12:34:12.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:34:12.408 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:34:12.408 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-09T12:34:12.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:36:24.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-09T12:36:24.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:36:29.414 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:36:29.414 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-09T12:36:29.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:38:32.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-07-09T12:38:32.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T12:38:37.386 ERROR:teuthology.orchestra.connection:Error authenticating with smithi172.front.sepia.ceph.com: Authentication failed. 2023-07-09T12:38:37.387 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-07-09T12:38:37.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-09T12:40:37.316 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-09T12:40:37.318 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi172 2023-07-09T12:40:37.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T12:40:37.320 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-09T12:40:42.409 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T12:41:02.478 DEBUG:teuthology.nuke:shortname: smithi079 2023-07-09T12:41:02.479 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T12:41:07.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-08_17:45:15-rados-reef-distro-default-smithi/7330425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 12:26:21.772017', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T12:41:12.515 DEBUG:teuthology.nuke:shortname: smithi172 2023-07-09T12:41:12.515 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T12:41:22.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-08_17:45:15-rados-reef-distro-default-smithi/7330425', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 12:26:21.774131', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-09T12:41:26.839 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-09T12:41:26.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T12:41:26.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:26.879 INFO:teuthology.orchestra.console:Power off smithi172 2023-07-09T12:41:26.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T12:41:26.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:30.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:30.923 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:35.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:35.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:40.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:40.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T12:41:40.322 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-09T12:41:48.903 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-07-09T12:41:48.935 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-07-09T12:41:49.050 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com 2023-07-09T12:41:54.316 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi172