2023-06-28T02:16:24.904 INFO:root:teuthology version: 0.0.1.dev130+g3fdf1f2
2023-06-28T02:16:24.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T02:16:24.906 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T02:16:39.567 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc6aa818730>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc6aba338b0>, signals=[15])
2023-06-28T02:16:39.569 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging
2023-06-28T02:16:39.569 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T02:16:39.569 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2023-06-28T02:16:39.592 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-06-28T02:16:39.593 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T02:16:39.593 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-06-28T02:16:39.594 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"}
2023-06-28T02:16:44.800 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging
2023-06-28T02:16:44.800 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T02:16:44.800 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server
2023-06-28T02:16:44.802 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-06-28T02:16:55.377 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /host {"name": "smithi116"}
2023-06-28T02:16:55.407 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T02:17:00.422 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T02:17:00.422 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 3}
2023-06-28T02:17:10.251 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T02:17:10.255 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T02:17:10.274 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.stream
2023-06-28T02:17:10.274 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-06-28T02:17:10.301 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T02:17:10.301 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 3}
2023-06-28T02:17:10.310 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T02:17:10.310 DEBUG:teuthology.provision.fog.smithi116:FOG request: PUT /host/221 {"imageID": 3}
2023-06-28T02:17:10.352 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T02:17:10.354 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream
2023-06-28T02:17:10.355 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T02:17:10.365 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream
2023-06-28T02:17:10.365 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-28T02:17:10.396 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1}
2023-06-28T02:17:10.429 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T02:17:15.437 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-06-28T02:17:15.439 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T02:17:25.495 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-06-28T02:17:30.507 DEBUG:teuthology.provision.fog.smithi116:FOG request: POST /host/221/task {"taskTypeID": 1}
2023-06-28T02:17:40.544 INFO:teuthology.orchestra.console:Power off smithi016
2023-06-28T02:17:40.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T02:17:40.578 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-28T02:17:45.558 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T02:17:45.664 INFO:teuthology.orchestra.console:Power off smithi116
2023-06-28T02:17:45.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T02:17:45.680 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-28T02:17:45.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T02:17:45.691 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:45.702 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:45.814 INFO:teuthology.orchestra.console:Power off for smithi116 completed
2023-06-28T02:17:45.824 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-28T02:17:45.916 INFO:teuthology.orchestra.console:Power on smithi116
2023-06-28T02:17:45.916 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T02:17:45.926 INFO:teuthology.orchestra.console:Power on smithi107
2023-06-28T02:17:45.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T02:17:45.937 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:45.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:49.964 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:49.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:50.176 INFO:teuthology.orchestra.console:Power on for smithi116 completed
2023-06-28T02:17:50.186 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2023-06-28T02:17:50.277 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish
2023-06-28T02:17:50.278 DEBUG:teuthology.provision.fog.smithi116:FOG request: GET /task/active None
2023-06-28T02:17:55.286 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2023-06-28T02:17:55.286 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T02:17:55.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:17:55.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:17:55.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:17:58.416 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:18:00.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:04.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:09.426 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:12.496 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:18:13.744 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-28T02:18:14.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:18.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:19.649 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:19.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:22.576 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:18:22.800 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-28T02:18:24.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:28.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:33.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:38.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:38.601 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:18:41.648 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-28T02:18:43.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:18:44.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:49.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:18:54.614 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:18:54.715 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2023-06-28T02:18:54.816 INFO:teuthology.orchestra.console:Power on smithi016
2023-06-28T02:18:54.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T02:18:57.680 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-28T02:18:59.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:19:00.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:05.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:10.624 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:19:13.680 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-28T02:19:15.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:19:15.944 INFO:teuthology.orchestra.console:Power on for smithi016 completed
2023-06-28T02:19:16.046 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2023-06-28T02:19:16.046 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-06-28T02:19:16.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:19.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:22.736 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116
2023-06-28T02:19:24.148 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:19:28.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:28.859 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: Authentication failed.
2023-06-28T02:19:28.861 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T02:19:28.861 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T02:19:28.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:29.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:30.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:30.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:31.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:32.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:33.200 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T02:19:33.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:34.640 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-06-28T02:19:34.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:35.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:36.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:37.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:38.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:39.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:44.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:19:49.214 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:49.285 ERROR:teuthology.orchestra.connection:Error authenticating with smithi107.front.sepia.ceph.com: Authentication failed.
2023-06-28T02:19:49.286 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T02:19:49.286 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T02:19:49.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:50.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:50.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:51.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:51.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:52.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:52.272 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-06-28T02:19:52.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:53.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:53.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:54.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:54.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:55.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:55.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:56.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:56.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:57.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:57.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:19:58.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:20:03.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:03.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:04.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:04.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:05.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:05.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:06.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:06.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:07.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:07.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:08.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:08.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:09.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:09.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:10.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:10.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:11.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:11.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:12.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:12.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:13.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:13.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:14.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:14.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:15.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:15.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:16.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:16.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:17.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:17.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:18.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:18.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:19.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:19.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:20.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:20.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:21.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:22.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:23.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:24.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:25.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:26.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:27.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:28.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:29.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:30.432 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:31.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:34.800 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-06-28T02:20:40.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T02:20:45.879 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: Authentication failed.
2023-06-28T02:20:45.879 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T02:20:45.880 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T02:20:45.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:46.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:47.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:48.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:49.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:50.912 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:51.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:52.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:53.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:54.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:55.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:56.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:57.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:58.971 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:20:59.979 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:00.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:01.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:03.004 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:04.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:05.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:06.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:07.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:08.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:09.054 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:10.061 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:11.069 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:12.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:13.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:14.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:15.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:16.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:17.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:18.131 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:19.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:20.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:21.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:22.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:23.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:24.186 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:25.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:26.203 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:27.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:28.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:29.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:30.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:31.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:32.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:21:33.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T02:22:07.984 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-06-28T02:22:07.987 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
    x = self.__socket.recv(n)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv
    return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer
2023-06-28T02:22:07.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T02:22:07.989 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T02:22:08.075 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T02:22:08.127 DEBUG:teuthology.nuke:shortname: smithi016
2023-06-28T02:22:08.127 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T02:22:08.154 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_20:22:12-rbd-wip-yuri11-testing-2023-06-27-0812-reef-distro-default-smithi/7318641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 02:16:24.023919', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC87N4ss0XcOmlZmebsdX7hNaoIYJ/+MzKPAy5IBzKVnAtTgB3qB8H/xjoIHb3uVWk8cjv46uFRLV0U2e3JkeIDHw+MxpnZSRZz27zUPOb5KvJW/o+FvvZfpfUJrI2n50quJ22zwkxJhzyV9aDYg+DaQsXICJsIsEQTotmBjqeTxg1VlKSXAwyAvyfwQhmdBM0TZq1evj+tDYM13kkZz9WXuUGEhWSjjkvHyb/tp832ArlXr1q4vwHlVwGghM8INKCWdyOcLkF2e1bTG4s/T6aOWs4bVDZAQyLDmQ0E/gHd8KpLQFdEyUGvMXDIO28HfZhFXoEp1ZtkPoqR8h7rIwRXsnwCuRrxowvYsDJVbyPwvyIMIrNdlqzYAR/W46zwoXBWhzqCrlHB+33k9BAV26dzjL/ML0uZOwcR5HffDVK5HCKZXdOzhkzKgHxqS8WBrLTT5j2IDkB0pedSno5WQXCwYFkQ9KTl2CAYrSOVL8Bc/sMuwbO4CohxE++0MyKGzZs='}
2023-06-28T02:22:08.160 DEBUG:teuthology.nuke:shortname: smithi107
2023-06-28T02:22:08.160 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T02:22:08.184 DEBUG:teuthology.nuke:shortname: smithi116
2023-06-28T02:22:08.185 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T02:22:08.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_20:22:12-rbd-wip-yuri11-testing-2023-06-27-0812-reef-distro-default-smithi/7318641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 02:16:24.027079', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-28T02:22:08.204 INFO:teuthology.orchestra.console:Power off smithi016
2023-06-28T02:22:08.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T02:22:08.216 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_20:22:12-rbd-wip-yuri11-testing-2023-06-27-0812-reef-distro-default-smithi/7318641', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 02:16:24.025640', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-06-28T02:22:08.226 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:13.254 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-28T02:22:13.255 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T02:22:13.295 INFO:teuthology.orchestra.console:Power off smithi116
2023-06-28T02:22:13.295 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T02:22:17.263 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:18.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:18.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:20.272 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-06-28T02:22:22.374 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:23.291 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:23.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:27.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:27.695 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2023-06-28T02:22:27.863 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com
2023-06-28T02:22:28.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:28.438 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:33.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:33.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:38.625 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:38.659 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:43.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:43.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:43.981 INFO:teuthology.orchestra.console:Power off for smithi116 completed
2023-06-28T02:22:44.151 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com
2023-06-28T02:22:48.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:53.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:22:59.068 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:23:04.179 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T02:23:04.390 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-28T02:23:04.556 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2023-06-28T02:23:04.928 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
    x = self.__socket.recv(n)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3fdf1f2d90b4263fafe8c0792229f37d37a2ab95/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv
    return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer