2023-07-02T09:57:04.542 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-02T09:57:04.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-02T09:57:04.543 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-02T09:57:04.694 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8486fd0610>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8486955ca0>, signals=[15])
2023-07-02T09:57:04.695 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging
2023-07-02T09:57:04.696 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server
2023-07-02T09:57:04.696 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server
2023-07-02T09:57:04.717 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2023-07-02T09:57:04.717 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2023-07-02T09:57:04.717 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-07-02T09:57:04.718 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /host {"name": "smithi130"}
2023-07-02T09:57:04.742 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /host {"name": "smithi167"}
2023-07-02T09:57:04.892 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-02T09:57:04.895 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-07-02T09:57:04.940 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-02T09:57:04.940 DEBUG:teuthology.provision.fog.smithi130:FOG request: PUT /host/235 {"imageID": 7}
2023-07-02T09:57:04.942 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.4 (ID 7)
2023-07-02T09:57:04.942 DEBUG:teuthology.provision.fog.smithi167:FOG request: PUT /host/272 {"imageID": 7}
2023-07-02T09:57:04.996 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of rhel 8.4
2023-07-02T09:57:04.997 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:57:04.998 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.4
2023-07-02T09:57:04.999 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-02T09:57:05.147 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /tasktype {"name": "deploy"}
2023-07-02T09:57:05.150 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /tasktype {"name": "deploy"}
2023-07-02T09:57:05.191 DEBUG:teuthology.provision.fog.smithi130:FOG request: POST /host/235/task {"taskTypeID": 1}
2023-07-02T09:57:05.193 DEBUG:teuthology.provision.fog.smithi167:FOG request: POST /host/272/task {"taskTypeID": 1}
2023-07-02T09:57:05.239 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-02T09:57:05.243 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:57:05.431 INFO:teuthology.orchestra.console:Power off smithi130
2023-07-02T09:57:05.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-02T09:57:05.445 INFO:teuthology.orchestra.console:Power off smithi167
2023-07-02T09:57:05.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-02T09:57:05.455 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:05.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:09.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:09.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:13.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:13.602 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:17.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:17.715 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:17.918 INFO:teuthology.orchestra.console:Power off for smithi130 completed
2023-07-02T09:57:17.923 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2023-07-02T09:57:18.020 INFO:teuthology.orchestra.console:Power on smithi130
2023-07-02T09:57:18.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-02T09:57:18.028 INFO:teuthology.orchestra.console:Power on smithi167
2023-07-02T09:57:18.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-02T09:57:18.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:18.047 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:22.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:22.071 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T09:57:22.273 INFO:teuthology.orchestra.console:Power on for smithi130 completed
2023-07-02T09:57:22.281 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2023-07-02T09:57:22.375 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish
2023-07-02T09:57:22.375 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:57:22.382 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2023-07-02T09:57:22.382 DEBUG:teuthology.provision.fog.smithi167:FOG request: GET /task/active None
2023-07-02T09:57:22.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:57:37.554 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:57:41.104 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:57:47.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:57:50.192 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:57:52.790 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:57:56.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:57:59.248 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:58:05.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:58:07.968 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:58:08.336 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:58:14.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:58:17.392 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:58:23.204 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:58:23.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:58:26.448 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:58:32.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:58:35.504 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:58:38.442 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:58:41.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:58:53.689 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:58:59.952 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:59:05.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:59:08.941 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:59:09.008 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-07-02T09:59:15.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T09:59:15.086 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed.
2023-07-02T09:59:15.087 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-02T09:59:15.088 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-02T09:59:15.089 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:16.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:17.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:18.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:19.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:20.111 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:21.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:22.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:23.123 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:24.127 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:24.275 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:59:25.132 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:26.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:27.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:28.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:29.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:30.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:31.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:32.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:33.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:34.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:35.172 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:36.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:37.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:38.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:39.187 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:39.572 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:59:40.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:41.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:42.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:43.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:44.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:45.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:46.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:47.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:48.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:49.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:50.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:51.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:52.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:53.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:54.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:54.864 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T09:59:55.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:56.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:57.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:58.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T09:59:59.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:00.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:01.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:02.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:03.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:04.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:05.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:06.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:07.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:08.308 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:09.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:10.149 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:00:10.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:11.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:12.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:13.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:14.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:15.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:16.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:17.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:18.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:19.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:20.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:21.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:22.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:23.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:24.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:25.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:25.425 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:00:26.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:27.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:28.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:29.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:30.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:31.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:32.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:33.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:34.417 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:35.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:36.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:37.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:38.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:39.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:40.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:40.675 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:00:41.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:42.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:43.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:44.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:45.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:46.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:47.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:48.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:49.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:50.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:51.484 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:52.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:53.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:54.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:55.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:55.925 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:00:56.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:57.511 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:58.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:00:59.520 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:00.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:01.529 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:02.535 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:03.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:04.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:05.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:06.551 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:07.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:08.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:09.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:10.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:11.188 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:01:11.574 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:12.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:13.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:14.587 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:15.020 ERROR:teuthology.provision.fog: on smithi167
2023-07-02T10:01:24.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-07-02T10:01:24.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:01:24.102 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed.
2023-07-02T10:01:24.102 DEBUG:teuthology.orchestra.run.smithi167:> true
2023-07-02T10:01:24.103 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:01:26.451 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:01:41.701 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:01:56.926 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:02:12.158 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:02:27.385 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:02:42.602 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:02:57.803 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:03:13.016 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:03:28.212 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None
2023-07-02T10:03:28.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:03:33.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-07-02T10:03:33.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:03:33.107 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: Authentication failed.
2023-07-02T10:03:33.107 DEBUG:teuthology.orchestra.run.smithi167:> true
2023-07-02T10:03:33.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-02T10:03:43.433 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-07-02T10:03:43.434 ERROR:paramiko.transport:Traceback (most recent call last):
2023-07-02T10:03:43.434 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-07-02T10:03:43.434 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-07-02T10:03:43.435 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-07-02T10:03:43.435 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-07-02T10:03:43.435 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 622, in _read_timeout
2023-07-02T10:03:43.435 ERROR:paramiko.transport:    raise socket.timeout()
2023-07-02T10:03:43.435 ERROR:paramiko.transport:socket.timeout
2023-07-02T10:03:43.436 ERROR:paramiko.transport:
2023-07-02T10:03:43.436 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-07-02T10:03:43.436 ERROR:paramiko.transport:
2023-07-02T10:03:43.436 ERROR:paramiko.transport:Traceback (most recent call last):
2023-07-02T10:03:43.436 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-07-02T10:03:43.437 ERROR:paramiko.transport:    self._check_banner()
2023-07-02T10:03:43.437 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-07-02T10:03:43.437 ERROR:paramiko.transport:    raise SSHException(
2023-07-02T10:03:43.437 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-07-02T10:03:43.437 ERROR:paramiko.transport:
2023-07-02T10:03:43.438 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: No SSH private key found!
2023-07-02T10:03:43.438 WARNING:teuthology.provision.fog.smithi130:Error reading SSH protocol banner
2023-07-02T10:03:49.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:03:52.048 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:03:58.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:03:58.704 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:04.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:05.360 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:11.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:12.016 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:18.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:18.672 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:24.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:25.328 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:31.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:41.456 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:47.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:50.512 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:04:56.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:04:58.352 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:05:04.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:05:07.408 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130
2023-07-02T10:05:13.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T10:05:14.626 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-02T10:05:14.627 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-02T10:05:30.287 INFO:teuthology.provision.fog.smithi130:Node is ready
2023-07-02T10:05:30.287 DEBUG:teuthology.orchestra.run.smithi130:> hostname
2023-07-02T10:05:30.302 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com
2023-07-02T10:05:30.302 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts
2023-07-02T10:05:30.355 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130
2023-07-02T10:05:30.356 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2023-07-02T10:05:30.483 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts
2023-07-02T10:05:30.506 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts
2023-07-02T10:05:30.569 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname
2023-07-02T10:05:30.633 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130
2023-07-02T10:05:30.695 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release
2023-07-02T10:05:30.748 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Red Hat Enterprise Linux"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8.4 (Ootpa)"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:ID="rhel"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="fedora"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8.4"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-02T10:05:30.749 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31"
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.redhat.com/"
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-02T10:05:30.750 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-02T10:05:30.751 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-02T10:05:30.751 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-02T10:05:30.751 INFO:teuthology.provision.fog.smithi130:Deploy complete!
2023-07-02T10:05:30.753 DEBUG:teuthology.parallel:result is None
2023-07-02T11:03:45.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-07-02T11:03:45.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-02T11:03:45.280 DEBUG:teuthology.orchestra.run.smithi167:> true
2023-07-02T11:03:45.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com'
2023-07-02T11:03:45.482 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-02T11:03:45.482 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-02T11:03:45.487 INFO:teuthology.provision.fog.smithi167:Node is ready
2023-07-02T11:03:45.488 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2023-07-02T11:03:45.494 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167
2023-07-02T11:03:45.494 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167 /etc/hosts
2023-07-02T11:03:45.499 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2023-07-02T11:03:45.500 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167 smithi167
2023-07-02T11:03:45.500 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-07-02T11:03:45.512 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hosts
2023-07-02T11:03:45.570 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2023-07-02T11:03:45.582 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167/smithi167/g' /etc/hostname
2023-07-02T11:03:45.594 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-07-02T11:03:45.608 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-07-02T11:03:45.612 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu"
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04"
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-02T11:03:45.613 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-02T11:03:45.614 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-02T11:03:45.614 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-02T11:03:45.614 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal
2023-07-02T11:03:45.614 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal
2023-07-02T11:03:45.616 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi167's OS to be rhel 8.4 but found ubuntu 20.04
2023-07-02T11:03:45.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-02T11:03:45.617 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-02T11:03:45.696 INFO:teuthology.nuke:Checking targets against current locks
2023-07-02T11:03:45.745 DEBUG:teuthology.nuke:shortname: smithi130
2023-07-02T11:03:45.745 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-02T11:03:45.770 DEBUG:teuthology.nuke:shortname: smithi167
2023-07-02T11:03:45.771 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-02T11:03:45.773 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-07-02_09:51:11-rados:thrash-wip-rf-59537-quincy-distro-default-smithi/7324341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-02 09:57:03.773719', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5SseDkL87Rz+GcAJYqS82m4lwHLUhPVXJubkPeGHsP0NHZnGasH8H9ALHNsQ09pQEmrbLKhKMLmWqBrOfjVk8='}
2023-07-02T11:03:45.801 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-07-02_09:51:11-rados:thrash-wip-rf-59537-quincy-distro-default-smithi/7324342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': False, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'}
2023-07-02T11:03:45.801 ERROR:teuthology.nuke:Could not nuke {'smithi167.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgDIqQrbxQ0s61QTnYYpFu2BLdBXS/2XOPEVWkAiV8ubK9rdV7YPSvpYlnQvKVjcgBGqTBPwxnixbgOLLHjJN04dLP5LXxyb5SxMW5uRhd7f2ew6/LPhUlXh+yBEz49TVUuNJqYXInXACYBmcK+42dW5gH9/QcgJy6GehfL8L/fWJSxk60oPPvnsEVWWbOQQWOMCTMTeqpx9Oj4fnx4zDP/oBBdFzma1M3wpOZveSUfjin8nD9XZ4mCGAME1S4j+frLvoflLvirPl9iCLgxHybV8C8SDvy/vRY63lvRndoDbcW+TmSUOGgddQqnqrGlayADvFZEa+ohCJYqlE+yeCOLvdrrM01EHGYC5FDNQx5HutQu//Eb1oX4/XE2PyqOdIEiym9aTTNwYTNdgqVIkPMa8Uo1m7RIyVQAgFzulclamj+a/JitL0562iiy+lLnjy7V/oYAVZ+kbYSZED3EpHB+hLf8EIWtCv/j3zhWjahl58diRdzjWKThX1vwurKrBM='}
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/nuke/__init__.py", line 294, in nuke_one
    nuke_helper(ctx, should_unlock, keep_logs, should_reboot)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/nuke/__init__.py", line 318, in nuke_helper
    check_lock.check_lock(ctx, None, check_up=False)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/task/internal/check_lock.py", line 28, in check_lock
    assert status['locked'], \
AssertionError: machine smithi167.front.sepia.ceph.com is not locked
2023-07-02T11:03:45.824 INFO:teuthology.orchestra.console:Power off smithi130
2023-07-02T11:03:45.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-02T11:03:45.969 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T11:03:49.992 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T11:03:54.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-02T11:03:54.364 INFO:teuthology.orchestra.console:Power off for smithi130 completed
2023-07-02T11:03:54.525 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com
2023-07-02T11:03:54.526 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgDIqQrbxQ0s61QTnYYpFu2BLdBXS/2XOPEVWkAiV8ubK9rdV7YPSvpYlnQvKVjcgBGqTBPwxnixbgOLLHjJN04dLP5LXxyb5SxMW5uRhd7f2ew6/LPhUlXh+yBEz49TVUuNJqYXInXACYBmcK+42dW5gH9/QcgJy6GehfL8L/fWJSxk60oPPvnsEVWWbOQQWOMCTMTeqpx9Oj4fnx4zDP/oBBdFzma1M3wpOZveSUfjin8nD9XZ4mCGAME1S4j+frLvoflLvirPl9iCLgxHybV8C8SDvy/vRY63lvRndoDbcW+TmSUOGgddQqnqrGlayADvFZEa+ohCJYqlE+yeCOLvdrrM01EHGYC5FDNQx5HutQu//Eb1oX4/XE2PyqOdIEiym9aTTNwYTNdgqVIkPMa8Uo1m7RIyVQAgFzulclamj+a/JitL0562iiy+lLnjy7V/oYAVZ+kbYSZED3EpHB+hLf8EIWtCv/j3zhWjahl58diRdzjWKThX1vwurKrBM=
2023-07-02T11:03:54.799 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi167's OS to be rhel 8.4 but found ubuntu 20.04