2023-07-21T10:49:30.926 INFO:root:teuthology version: 0.0.1.dev153+g79491cb
2023-07-21T10:49:30.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T10:49:30.928 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T10:49:31.119 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7feb495675b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7feb48f25e50>, signals=[15])
2023-07-21T10:49:31.121 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging
2023-07-21T10:49:31.122 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T10:49:31.122 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2023-07-21T10:49:31.148 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2023-07-21T10:49:31.148 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T10:49:31.149 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2023-07-21T10:49:31.150 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"}
2023-07-21T10:49:31.172 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2023-07-21T10:49:31.173 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2023-07-21T10:49:31.173 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-07-21T10:49:31.176 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"}
2023-07-21T10:49:31.206 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"}
2023-07-21T10:49:31.233 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T10:49:31.247 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T10:49:31.271 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T10:49:31.271 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 10}
2023-07-21T10:49:31.277 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-21T10:49:31.285 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T10:49:31.285 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 10}
2023-07-21T10:49:31.315 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream
2023-07-21T10:49:31.316 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T10:49:31.319 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10)
2023-07-21T10:49:31.320 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 10}
2023-07-21T10:49:31.325 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream
2023-07-21T10:49:31.326 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:49:31.366 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T10:49:31.372 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream
2023-07-21T10:49:31.372 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T10:49:31.379 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T10:49:31.408 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1}
2023-07-21T10:49:31.419 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1}
2023-07-21T10:49:31.422 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"}
2023-07-21T10:49:31.462 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1}
2023-07-21T10:49:31.466 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T10:49:31.492 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:49:31.512 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T10:49:31.566 INFO:teuthology.orchestra.console:Power off smithi084
2023-07-21T10:49:31.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T10:49:31.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:31.604 INFO:teuthology.orchestra.console:Power off smithi088
2023-07-21T10:49:31.605 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T10:49:31.618 INFO:teuthology.orchestra.console:Power off smithi191
2023-07-21T10:49:31.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T10:49:31.628 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:31.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:35.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:35.654 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:35.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:40.751 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:40.764 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:40.775 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:45.862 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:45.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:45.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:46.083 INFO:teuthology.orchestra.console:Power off for smithi088 completed
2023-07-21T10:49:46.184 INFO:teuthology.orchestra.console:Power on smithi088
2023-07-21T10:49:46.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T10:49:46.207 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:50.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:50.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:50.995 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:51.183 INFO:teuthology.orchestra.console:Power off for smithi084 completed
2023-07-21T10:49:51.285 INFO:teuthology.orchestra.console:Power on smithi084
2023-07-21T10:49:51.285 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T10:49:51.306 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:54.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:54.555 INFO:teuthology.orchestra.console:Power on for smithi088 completed
2023-07-21T10:49:54.656 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2023-07-21T10:49:54.657 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:49:55.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:49:55.542 INFO:teuthology.orchestra.console:Power on for smithi084 completed
2023-07-21T10:49:55.644 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2023-07-21T10:49:55.644 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T10:49:56.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:50:01.220 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:50:06.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:50:06.544 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2023-07-21T10:50:06.645 INFO:teuthology.orchestra.console:Power on smithi191
2023-07-21T10:50:06.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-21T10:50:06.666 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:50:09.728 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:50:14.737 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:50:14.746 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T10:50:24.859 INFO:teuthology.orchestra.console:Power on for smithi191 completed
2023-07-21T10:50:24.959 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2023-07-21T10:50:24.960 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-07-21T10:50:25.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:50:28.176 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T10:50:34.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:50:39.818 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:50:44.825 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T10:50:44.826 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T10:50:50.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:50:58.896 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T10:51:00.184 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-07-21T10:51:00.186 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:51:00.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:51:10.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:51:13.332 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T10:51:14.324 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T10:51:19.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:51:24.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:51:29.348 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:51:29.350 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T10:51:35.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:51:43.440 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T10:51:44.434 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:51:49.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:51:54.447 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-07-21T10:51:57.520 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T10:52:00.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:52:05.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:52:10.462 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:52:15.473 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T10:52:15.536 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: Authentication failed.
2023-07-21T10:52:15.537 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T10:52:15.538 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T10:52:15.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:16.545 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:17.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:18.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:19.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:20.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:21.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:52:26.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:27.486 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:28.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:29.497 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:30.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:30.536 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:52:33.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:34.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:35.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:36.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:37.138 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:38.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:39.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:40.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:41.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:42.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:43.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:44.173 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:45.040 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-07-21T10:52:45.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:46.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:47.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:48.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:52:48.200 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None
2023-07-21T10:52:53.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:52:58.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:53:03.285 ERROR:teuthology.orchestra.connection:Error authenticating with smithi084.front.sepia.ceph.com: Authentication failed.
2023-07-21T10:53:03.286 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T10:53:03.286 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T10:53:03.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:04.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:05.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:06.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:06.352 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-07-21T10:53:07.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:08.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:09.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:10.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:11.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:12.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:12.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:53:17.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:18.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:19.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:20.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:20.436 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-07-21T10:53:21.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:22.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:23.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:24.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:25.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:26.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:26.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:53:31.442 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:32.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:33.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:34.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:34.516 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-07-21T10:53:35.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:36.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:37.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:38.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:39.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:40.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-21T10:53:40.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:53:48.592 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-07-21T10:53:54.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:53:57.648 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2023-07-21T10:54:03.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:54:45.872 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-21T10:54:45.874 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi191
2023-07-21T10:54:54.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2023-07-21T10:54:54.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:54:55.056 DEBUG:teuthology.orchestra.run.smithi191:> true
2023-07-21T10:54:55.299 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2023-07-21T10:54:55.300 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-21T10:54:55.300 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-21T10:54:55.319 INFO:teuthology.provision.fog.smithi191:Node is ready
2023-07-21T10:54:55.319 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2023-07-21T10:54:55.378 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2023-07-21T10:54:55.378 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2023-07-21T10:54:55.436 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2023-07-21T10:54:55.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-07-21T10:54:55.504 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2023-07-21T10:54:55.574 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2023-07-21T10:54:55.642 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2023-07-21T10:54:55.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-07-21T10:54:55.778 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-07-21T10:54:55.836 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-21T10:54:55.837 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-07-21T10:54:55.838 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-21T10:54:55.838 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2023-07-21T10:54:55.838 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-21T10:54:55.838 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-21T10:54:55.838 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-21T10:54:55.840 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi191's OS to be centos 9 but found centos 8
2023-07-21T10:54:55.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-21T10:54:55.842 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-21T10:55:00.501 INFO:teuthology.nuke:Checking targets against current locks
2023-07-21T10:55:00.525 INFO:teuthology.nuke:Not nuking smithi084.front.sepia.ceph.com because description doesn't match: yuriw-2023-07-21_02:03:59-rbd-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346052
2023-07-21T10:55:00.577 INFO:teuthology.nuke:Not nuking smithi191.front.sepia.ceph.com because description doesn't match: yuriw-2023-07-21_02:03:59-rbd-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-rados-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346051
2023-07-21T10:55:00.579 DEBUG:teuthology.nuke:shortname: smithi088
2023-07-21T10:55:00.579 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-21T10:55:00.603 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:59-rbd-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346050', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 10:49:30.047840', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-21T10:55:00.655 INFO:teuthology.orchestra.console:Power off smithi088
2023-07-21T10:55:00.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-21T10:55:00.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:55:03.652 WARNING:teuthology.provision.fog.smithi088:timed out
2023-07-21T10:55:04.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:55:09.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-21T10:55:09.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:55:14.925 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:55:20.037 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:55:25.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-21T10:55:25.362 INFO:teuthology.orchestra.console:Power off for smithi088 completed
2023-07-21T10:55:25.513 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2023-07-21T10:55:25.516 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
  smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=
2023-07-21T10:55:25.899 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi191's OS to be centos 9 but found centos 8