2023-07-26T21:11:07.576 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-26T21:11:07.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T21:11:07.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T21:11:07.745 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff49985edf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff4991d7430>, signals=[15])
2023-07-26T21:11:07.747 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-07-26T21:11:07.747 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T21:11:07.747 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-07-26T21:11:07.775 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-07-26T21:11:07.776 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T21:11:07.776 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-07-26T21:11:07.778 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"}
2023-07-26T21:11:07.800 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-07-26T21:11:07.871 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-26T21:11:07.889 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-26T21:11:07.915 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_9.stream (ID 10)
2023-07-26T21:11:07.916 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 10}
2023-07-26T21:11:07.942 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10)
2023-07-26T21:11:07.942 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 10}
2023-07-26T21:11:07.958 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 9.stream
2023-07-26T21:11:07.958 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-07-26T21:11:07.994 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream
2023-07-26T21:11:07.994 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:11:08.017 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T21:11:08.049 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T21:11:08.061 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1}
2023-07-26T21:11:08.084 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-07-26T21:11:08.134 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-07-26T21:11:08.136 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:11:08.221 INFO:teuthology.orchestra.console:Power off smithi169
2023-07-26T21:11:08.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T21:11:08.240 INFO:teuthology.orchestra.console:Power off smithi120
2023-07-26T21:11:08.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T21:11:08.252 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T21:11:08.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:08.274 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T21:11:08.275 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:08.289 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:11:08.301 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:11:12.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:12.302 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:12.402 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:11:12.414 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:11:16.404 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:16.415 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:16.517 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T21:11:16.525 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:11:16.619 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2023-07-26T21:11:16.720 INFO:teuthology.orchestra.console:Power on smithi169
2023-07-26T21:11:16.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T21:11:16.746 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T21:11:16.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:17.757 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:20.529 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:21.640 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:21.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:22.868 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:25.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:26.755 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:26.870 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:27.979 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:30.759 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:31.871 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:31.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:33.092 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:35.875 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:35.985 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T21:11:36.086 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2023-07-26T21:11:36.187 INFO:teuthology.orchestra.console:Power on smithi120
2023-07-26T21:11:36.187 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T21:11:36.209 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T21:11:36.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:36.232 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T21:11:37.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:38.204 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:40.235 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:41.346 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:42.205 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:43.315 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:45.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:46.458 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:47.317 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:48.428 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:50.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:51.570 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:11:52.430 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:52.539 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:11:52.640 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2023-07-26T21:11:52.741 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-07-26T21:11:52.741 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:11:56.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:11:58.107 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:12:02.110 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:12:03.220 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:12:07.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:12:07.331 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:12:07.432 INFO:teuthology.orchestra.console:Power on for smithi120 completed
2023-07-26T21:12:07.533 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-07-26T21:12:07.534 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-07-26T21:12:22.540 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:12:27.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:12:35.664 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-07-26T21:12:41.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:12:44.720 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-07-26T21:12:47.612 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:12:52.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:13:12.708 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:13:16.144 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-07-26T21:13:22.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:13:22.264 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: Authentication failed.
2023-07-26T21:13:22.267 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T21:13:22.267 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T21:13:22.268 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:23.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:24.278 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:25.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:26.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:27.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:28.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:28.325 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:13:33.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:34.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:35.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:36.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:37.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:38.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:39.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:40.369 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:41.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:42.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:43.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:44.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:45.397 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:46.402 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:47.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:48.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:48.416 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:13:53.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:54.428 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:55.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:56.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:57.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:58.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:13:59.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:00.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:01.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:02.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:03.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:04.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:05.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:06.494 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:07.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:08.484 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-07-26T21:14:08.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:08.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:14:09.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:10.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:11.521 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:11.632 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:14:12.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:13.532 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:14.537 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:15.543 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:16.547 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:17.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-26T21:14:17.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:14:20.688 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:14:26.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:14:29.744 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:14:35.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:14:38.800 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:14:44.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:14:47.856 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:14:53.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:15:01.940 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:15:07.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:15:27.728 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:15:33.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:15:36.784 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-07-26T21:15:42.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:15:43.025 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T21:15:43.025 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T21:16:06.640 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-26T21:16:06.641 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi120
2023-07-26T21:16:08.617 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-07-26T21:16:08.617 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-07-26T21:16:08.636 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2023-07-26T21:16:08.637 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2023-07-26T21:16:08.694 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2023-07-26T21:16:08.694 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-07-26T21:16:08.832 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2023-07-26T21:16:08.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2023-07-26T21:16:08.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2023-07-26T21:16:09.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-07-26T21:16:09.069 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-07-26T21:16:09.124 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T21:16:09.125 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-07-26T21:16:09.126 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2023-07-26T21:16:09.126 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T21:16:09.126 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-07-26T21:16:09.126 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T21:16:09.126 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T21:16:09.126 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T21:16:09.127 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-07-26T21:16:09.128 DEBUG:teuthology.parallel:result is None
2023-07-26T21:16:15.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-07-26T21:16:15.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T21:16:15.718 DEBUG:teuthology.orchestra.run.smithi120:> true
2023-07-26T21:16:15.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-07-26T21:16:15.849 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T21:16:15.850 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T21:16:15.905 INFO:teuthology.provision.fog.smithi120:Node is ready
2023-07-26T21:16:15.906 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2023-07-26T21:16:15.962 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2023-07-26T21:16:15.963 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts
2023-07-26T21:16:16.019 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2023-07-26T21:16:16.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-07-26T21:16:16.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts
2023-07-26T21:16:16.156 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2023-07-26T21:16:16.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname
2023-07-26T21:16:16.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-07-26T21:16:16.353 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-07-26T21:16:16.410 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux"
2023-07-26T21:16:16.410 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)"
2023-07-26T21:16:16.410 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel"
2023-07-26T21:16:16.410 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora"
2023-07-26T21:16:16.410 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-26T21:16:16.411 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T21:16:16.412 INFO:teuthology.orchestra.run.smithi120.stdout:
2023-07-26T21:16:16.412 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-26T21:16:16.412 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-26T21:16:16.412 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-26T21:16:16.412 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-26T21:16:16.413 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi120's OS to be centos 9 but found rhel 8.6
2023-07-26T21:16:16.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T21:16:16.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T21:16:16.632 INFO:teuthology.nuke:Checking targets against current locks
2023-07-26T21:16:16.655 INFO:teuthology.nuke:Not nuking smithi120.front.sepia.ceph.com because description doesn't match: yuriw-2023-07-26_14:28:57-fs-wip-yuri-testing-2023-07-25-0833-reef-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353119
2023-07-26T21:16:16.694 DEBUG:teuthology.nuke:shortname: smithi169
2023-07-26T21:16:16.694 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-26T21:16:16.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_14:28:57-fs-wip-yuri-testing-2023-07-25-0833-reef-distro-default-smithi/7353118', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 21:11:06.754528', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUeSdCGqxm/9M48vJ+Jn6Ua2HcLX9M3KTDHsM8vhfPORbR0T55WFK4Sr9ctwQPGzFC48a7/ob5jjmVApxvC1ZPMbeT9Xi/UhWzCUc3SVADnfqgwMAMl088joXdDl/S6M55RKRCYLYqbiXwL4UedrDfskCL3kiDNApvfNOwi9/yeog7RnJV1JZ9jOXLwnacKum6jwLhH1FgRhMkvz9rFFu7pYWqkDHR4wl9TuOadPBJInVOhW6UjY8TVmo6QYjxg2BS0CEjsPjxRKnZn/55K7lIvOM429vVJts99aviFyTx9Vvads5LPBgcuNsLsygcMlNKwxhT6eiLkKDrldnOcnxAfE4xAqdNy0wemWL/vo+t0GvcZX2kKqb5k0vfPZGhwzRhhqj4NAHrbhCvpUe8+oKBwfBQHIaepEcOpe6bw0AqR0OvLoL5AmZDG1HuBjxf4c46oqgKjE7BMZ/FN2zwYYnYbRoj+WujurUA49mp4zfnlMXhDnKaZR2ZmIOz8cNatlU='}
2023-07-26T21:16:16.765 INFO:teuthology.orchestra.console:Power off smithi169
2023-07-26T21:16:16.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T21:16:16.788 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T21:16:16.789 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:16:16.809 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:16:20.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:16:20.920 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T21:16:24.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:16:26.031 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:16:30.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:16:31.144 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T21:16:35.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T21:16:35.255 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T21:16:35.357 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2023-07-26T21:16:39.803 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com
2023-07-26T21:16:39.805 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi120.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx0+txyLaNIGhvXVHaDVBFWhf9syl4SDc3b1AcnbmSkS6ePm/c+4l49BlVmS1KcDLWYelRnla2qm6J+pTOnFO8dC2gc4mZ/DzLQq0phOQB+4C/ev2QsLFKyHhhOFgQyz/zrm6F+Li3NknIdCDUCvxHzgiKxZdJYhSTva/x57k7vv8gCx19eWr3OiAvqJnGgbN5DNxmCbBARdjsqWVIR639JfH4fego0stvPd/USMWEdLAhmX9/eXdCxDaEU01/66VjoY1fUix2ZXT1sY6Rg+lrfDV+vkrQw/AeEe/7eW8lBjfzGei/xI5Cyf4/tIOKIEE43VWXmVcEF++RlT0CBbZzo3WirqYeYCGcbuiogooVrfXYg7MTg10gXkUYV3DoqyffmVr9Jbw144C5ovMtJzSLjvgGehdRGlvLzUtu9ZW0KN1ev4fePbVhBuHXqKBrE+aPpcAjCX5rf8xqinKC169lRCYGDxN/Hhbv4DZ0Bv3Q4qRJ0Gt9cnfvOvLesrv5J38=
2023-07-26T21:16:45.033 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi120's OS to be centos 9 but found rhel 8.6