2023-06-28T16:51:02.551 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T16:51:02.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T16:51:02.553 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T16:51:02.702 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f38dcc225e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f38dc5e0af0>, signals=[15])
2023-06-28T16:51:02.704 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-06-28T16:51:02.704 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T16:51:02.705 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-06-28T16:51:02.729 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-06-28T16:51:02.730 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T16:51:02.730 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-06-28T16:51:02.731 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-06-28T16:51:07.878 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"}
2023-06-28T16:51:12.963 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T16:51:17.970 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T16:51:23.028 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T16:51:23.029 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 3}
2023-06-28T16:51:28.037 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T16:51:28.037 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 3}
2023-06-28T16:51:28.101 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream
2023-06-28T16:51:28.102 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-06-28T16:51:28.104 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream
2023-06-28T16:51:28.105 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-06-28T16:51:28.174 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T16:51:38.183 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T16:51:38.290 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1}
2023-06-28T16:51:38.294 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-06-28T16:51:38.370 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-06-28T16:51:38.372 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-06-28T16:51:43.461 INFO:teuthology.orchestra.console:Power off smithi120
2023-06-28T16:51:43.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:51:43.480 INFO:teuthology.orchestra.console:Power off smithi105
2023-06-28T16:51:43.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:51:48.487 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:48.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:53.504 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:53.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:53.715 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2023-06-28T16:51:53.817 INFO:teuthology.orchestra.console:Power on smithi120
2023-06-28T16:51:53.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T16:51:53.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:57.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:58.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:51:58.841 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-06-28T16:51:58.942 INFO:teuthology.orchestra.console:Power on smithi105
2023-06-28T16:51:58.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T16:51:58.963 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:02.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:02.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:08.095 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:08.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:13.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:13.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:13.421 INFO:teuthology.orchestra.console:Power on for smithi120 completed
2023-06-28T16:52:13.522 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-06-28T16:52:13.523 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-06-28T16:52:18.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:52:22.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:27.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:32.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:36.848 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T16:52:37.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:52:37.854 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2023-06-28T16:52:37.955 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-06-28T16:52:37.955 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-06-28T16:52:42.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:52:51.024 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T16:52:57.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:53:03.048 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-06-28T16:53:08.054 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T16:53:14.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:53:22.128 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T16:53:23.127 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-06-28T16:53:28.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:53:31.184 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T16:53:37.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:53:42.312 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: Authentication failed.
2023-06-28T16:53:42.314 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T16:53:42.315 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T16:53:42.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:43.199 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-06-28T16:53:48.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:48.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:53:53.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:53.326 ERROR:teuthology.orchestra.connection:Error authenticating with smithi105.front.sepia.ceph.com: Authentication failed.
2023-06-28T16:53:53.326 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T16:53:53.327 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T16:53:53.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:54.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:54.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:55.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:55.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:56.281 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:56.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:57.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:57.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:58.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:58.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:59.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:53:59.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:00.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:00.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:01.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:01.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:02.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:02.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:03.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:03.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:04.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:04.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:05.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:05.449 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:06.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:06.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:07.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:07.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:08.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:08.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:09.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:09.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:10.457 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:10.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:11.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:11.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:12.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:12.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:13.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:13.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:14.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:14.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:15.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:15.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:16.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:16.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:17.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:17.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:18.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:18.589 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:19.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:19.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:20.558 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:20.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:21.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:21.636 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:22.639 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:22.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:23.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:23.652 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:24.658 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:24.662 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:25.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:25.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:26.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:26.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:27.691 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:27.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:28.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:28.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:29.711 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:29.712 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:30.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:30.720 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:31.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:31.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:32.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:32.741 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:33.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:33.749 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:34.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:34.757 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:35.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:35.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:36.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:36.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:37.780 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:37.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:38.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:38.789 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:39.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:39.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:40.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:40.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:41.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:41.810 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:42.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:42.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:43.827 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:43.828 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:44.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:44.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:45.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:45.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:46.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:46.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:47.855 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:47.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:48.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:48.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:49.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:49.871 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:50.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:50.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:51.884 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:51.885 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:52.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:52.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:53.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:53.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:54.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:54.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:55.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:55.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:56.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:56.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:57.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:57.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:58.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:58.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:59.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:54:59.945 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:00.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:00.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:01.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:01.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:02.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:02.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:03.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:03.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:04.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:04.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:05.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:05.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:06.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:06.991 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:07.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:07.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:09.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:09.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:10.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:10.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:11.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:11.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:12.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:12.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:13.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:13.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:14.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:14.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:15.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:15.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:16.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:16.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:17.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:17.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:18.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:18.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:19.073 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:19.074 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:20.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:20.080 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:21.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:21.087 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:22.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:22.093 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:23.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:23.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:24.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:24.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:25.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:25.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:26.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:26.117 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:27.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:27.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:28.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:28.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:29.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:29.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:30.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:30.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:31.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:31.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:32.160 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:32.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:33.167 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:34.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:35.182 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:36.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:37.196 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:38.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:39.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:40.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:41.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:42.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:43.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:44.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:45.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:46.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:47.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:48.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:49.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:50.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:51.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:52.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T16:55:53.259 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all
    raise EOFError()
EOFError
2023-06-28T16:55:53.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T16:55:53.263 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T16:55:58.370 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T16:56:08.167 DEBUG:teuthology.nuke:shortname: smithi105
2023-06-28T16:56:08.167 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T16:56:08.190 DEBUG:teuthology.nuke:shortname: smithi120
2023-06-28T16:56:08.190 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T16:56:08.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320432', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 16:51:01.776071', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-06-28T16:56:13.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320432', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 16:51:01.777996', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-06-28T16:56:18.267 INFO:teuthology.orchestra.console:Power off smithi105
2023-06-28T16:56:18.268 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:56:23.285 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:23.317 INFO:teuthology.orchestra.console:Power off smithi120
2023-06-28T16:56:23.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:56:28.298 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:28.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:33.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:33.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:38.471 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:38.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:43.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:43.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:56:43.847 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-06-28T16:56:54.008 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2023-06-28T16:56:54.032 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-06-28T16:56:56.415 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2023-06-28T16:56:56.644 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all
    raise EOFError()
EOFError