2023-07-21T03:07:18.933 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-21T03:07:18.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T03:07:18.934 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T03:07:33.733 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9596b605e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f95965119d0>, signals=[15])
2023-07-21T03:07:33.735 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging
2023-07-21T03:07:33.735 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T03:07:33.735 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2023-07-21T03:07:33.761 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2023-07-21T03:07:33.762 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T03:07:33.762 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-07-21T03:07:33.764 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"}
2023-07-21T03:07:33.786 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging
2023-07-21T03:07:33.787 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T03:07:33.787 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2023-07-21T03:07:33.789 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"}
2023-07-21T03:07:33.811 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"}
2023-07-21T03:07:33.838 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-21T03:07:33.868 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-21T03:07:33.878 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-21T03:07:33.884 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-21T03:07:33.884 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 5}
2023-07-21T03:07:33.917 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-21T03:07:33.917 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 5}
2023-07-21T03:07:33.923 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-21T03:07:33.923 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5}
2023-07-21T03:07:33.937 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.6
2023-07-21T03:07:33.938 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T03:07:33.959 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6
2023-07-21T03:07:33.959 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-07-21T03:07:33.962 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6
2023-07-21T03:07:33.962 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-07-21T03:07:33.995 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T03:07:44.006 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T03:07:44.008 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T03:07:54.060 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1}
2023-07-21T03:07:59.067 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1}
2023-07-21T03:07:59.068 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1}
2023-07-21T03:08:09.133 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-07-21T03:08:14.142 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T03:08:14.143 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-07-21T03:08:15.043 INFO:teuthology.orchestra.console:Power off smithi084
2023-07-21T03:08:15.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T03:08:15.062 INFO:teuthology.orchestra.console:Power off smithi140
2023-07-21T03:08:15.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T03:08:15.077 INFO:teuthology.orchestra.console:Power off smithi112
2023-07-21T03:08:15.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T03:08:15.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:15.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:15.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:15.224 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2023-07-21T03:08:15.226 INFO:teuthology.orchestra.console:Power off for smithi112 completed
2023-07-21T03:08:15.234 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2023-07-21T03:08:15.325 INFO:teuthology.orchestra.console:Power on smithi084
2023-07-21T03:08:15.326 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T03:08:15.336 INFO:teuthology.orchestra.console:Power on smithi112
2023-07-21T03:08:15.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T03:08:15.345 INFO:teuthology.orchestra.console:Power on smithi140
2023-07-21T03:08:15.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T03:08:15.358 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:15.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:15.382 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:19.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:19.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:19.409 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:24.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:24.514 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:24.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:29.617 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:29.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:29.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:34.731 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:34.741 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:34.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:39.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:39.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:39.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:40.057 INFO:teuthology.orchestra.console:Power on for smithi084 completed
2023-07-21T03:08:40.158 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2023-07-21T03:08:40.158 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T03:08:40.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:08:43.280 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T03:08:44.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:44.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:08:45.186 INFO:teuthology.orchestra.console:Power on for smithi140 completed
2023-07-21T03:08:45.287 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2023-07-21T03:08:45.287 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-07-21T03:08:50.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:08:55.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:00.357 INFO:teuthology.orchestra.console:Power on for smithi112 completed
2023-07-21T03:09:00.357 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T03:09:00.459 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2023-07-21T03:09:00.459 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-07-21T03:09:05.465 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-07-21T03:09:05.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:10.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:15.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:20.545 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-07-21T03:09:20.546 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T03:09:23.600 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-07-21T03:09:26.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:31.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:36.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:09:50.064 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-07-21T03:09:54.928 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T03:09:56.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:10:01.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:10:06.143 ERROR:teuthology.orchestra.connection:Error authenticating with smithi112.front.sepia.ceph.com: Authentication failed.
2023-07-21T03:10:06.145 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T03:10:06.146 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T03:10:06.148 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:06.157 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: Authentication failed.
2023-07-21T03:10:06.158 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T03:10:06.158 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T03:10:06.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:07.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:07.167 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:08.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:08.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:09.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:09.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:10.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:10.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:11.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:11.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:12.209 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:12.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:13.179 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed.
2023-07-21T03:10:13.180 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T03:10:13.180 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T03:10:13.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:13.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:13.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:14.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:14.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:14.236 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:15.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:15.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:15.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:16.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:16.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:16.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:17.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:17.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:17.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:18.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:18.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:18.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:19.234 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:19.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:19.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:20.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:20.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:20.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:21.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:21.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:21.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:22.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:22.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:22.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:23.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:23.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:23.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:24.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:24.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:24.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:25.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:25.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:25.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:26.298 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:26.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:26.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:27.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:27.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:27.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:28.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:28.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:28.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:29.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:29.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:29.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:30.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:30.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:30.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:31.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:31.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:31.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:32.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:32.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:32.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:33.369 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:33.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:33.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:34.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:34.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:34.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:35.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:35.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:35.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:36.397 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:36.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:36.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:37.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:37.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:37.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:38.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:38.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:38.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:39.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:39.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:39.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:40.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:40.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:40.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:41.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:41.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:41.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:42.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:42.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:42.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:43.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:43.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:43.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:44.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:44.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:44.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:45.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:45.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:45.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:46.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:46.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:46.542 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:47.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:47.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:47.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:48.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:48.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:48.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:49.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:49.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:49.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:50.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:50.582 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:50.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:51.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:51.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:51.594 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:52.563 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:52.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:52.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:53.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:53.613 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:53.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:54.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:54.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:54.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:55.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:55.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:55.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:56.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:56.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:56.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:57.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:57.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:57.660 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:58.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:58.667 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:59.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:10:59.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:00.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:00.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:01.653 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:01.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:02.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:03.673 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:04.682 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:05.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:06.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:07.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:08.723 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:09.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:10.744 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:11:11.752 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T03:12:46.192 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-21T03:12:46.194 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi112
2023-07-21T03:12:50.288 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-21T03:12:50.289 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi084
2023-07-21T03:12:55.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-07-21T03:12:55.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:12:55.538 DEBUG:teuthology.orchestra.run.smithi112:> true
2023-07-21T03:12:55.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-07-21T03:12:55.795 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T03:12:55.795 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T03:12:55.853 INFO:teuthology.provision.fog.smithi112:Node is ready
2023-07-21T03:12:55.853 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2023-07-21T03:12:55.911 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2023-07-21T03:12:55.911 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2023-07-21T03:12:55.970 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2023-07-21T03:12:55.970 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-07-21T03:12:56.086 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2023-07-21T03:12:56.115 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2023-07-21T03:12:56.182 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2023-07-21T03:12:56.249 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-07-21T03:12:56.315 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-07-21T03:12:56.371 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-21T03:12:56.372 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-21T03:12:56.373 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-21T03:12:56.374 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-21T03:12:56.374 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2023-07-21T03:12:56.375 DEBUG:teuthology.parallel:result is None
2023-07-21T03:12:59.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2023-07-21T03:12:59.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T03:13:04.635 DEBUG:teuthology.orchestra.run.smithi084:> true
2023-07-21T03:13:04.949 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com'
2023-07-21T03:13:04.949 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T03:13:04.949 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T03:13:04.967 INFO:teuthology.provision.fog.smithi084:Node is ready
2023-07-21T03:13:04.968 DEBUG:teuthology.orchestra.run.smithi084:> hostname
2023-07-21T03:13:05.025 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com
2023-07-21T03:13:05.026 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts
2023-07-21T03:13:05.084 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084
2023-07-21T03:13:05.084 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2023-07-21T03:13:05.204 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts
2023-07-21T03:13:05.232 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts
2023-07-21T03:13:05.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname
2023-07-21T03:13:05.368 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2023-07-21T03:13:05.434 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2023-07-21T03:13:05.490 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux"
2023-07-21T03:13:05.490 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.6 (Ootpa)"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.6"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2023-07-21T03:13:05.491 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/"
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-21T03:13:05.492 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-21T03:13:05.493 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-21T03:13:05.493 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2023-07-21T03:13:05.493 DEBUG:teuthology.parallel:result is None
2023-07-21T03:20:13.224 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 522, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1054, in open_channel
    raise SSHException("Timeout opening channel.")
paramiko.ssh_exception.SSHException: Timeout opening channel.
2023-07-21T03:20:13.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T03:20:13.225 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T03:20:15.407 INFO:teuthology.nuke:Checking targets against current locks
2023-07-21T03:20:15.460 DEBUG:teuthology.nuke:shortname: smithi084
2023-07-21T03:20:15.461 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T03:20:15.481 DEBUG:teuthology.nuke:shortname: smithi112
2023-07-21T03:20:15.482 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T03:20:15.484 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-21_01:10:44-fs:workload-wip-pdonnell-testing-20230720.223327-distro-default-smithi/7345675', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 03:07:17.938101', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-21T03:20:15.496 DEBUG:teuthology.nuke:shortname: smithi140
2023-07-21T03:20:15.497 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T03:20:15.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-21_01:10:44-fs:workload-wip-pdonnell-testing-20230720.223327-distro-default-smithi/7345675', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 03:07:17.942074', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-21T03:20:15.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-21_01:10:44-fs:workload-wip-pdonnell-testing-20230720.223327-distro-default-smithi/7345677', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 03:11:39.266636', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHtmaAXzlnBfpL06xHub6PXFGKgqKyLwFSEjxl5dTKPQ'}
2023-07-21T03:20:15.538 INFO:teuthology.orchestra.console:Power off smithi084
2023-07-21T03:20:15.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T03:20:15.554 INFO:teuthology.orchestra.console:Power off smithi112
2023-07-21T03:20:15.555 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T03:20:15.570 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:15.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:15.599 INFO:teuthology.orchestra.console:Power off smithi140
2023-07-21T03:20:15.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T03:20:15.623 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:19.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:19.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:19.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:23.723 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:23.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:23.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:27.837 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:27.847 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:27.869 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T03:20:28.049 INFO:teuthology.orchestra.console:Power off for smithi112 completed
2023-07-21T03:20:28.060 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2023-07-21T03:20:28.083 INFO:teuthology.orchestra.console:Power off for smithi140 completed
2023-07-21T03:20:28.201 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2023-07-21T03:20:28.209 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com
2023-07-21T03:20:28.235 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2023-07-21T03:20:28.688 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/remote.py", line 522, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1054, in open_channel
    raise SSHException("Timeout opening channel.")
paramiko.ssh_exception.SSHException: Timeout opening channel.