2023-07-28T09:13:55.074 INFO:root:teuthology version: 0.0.1.dev165+g3117e89
2023-07-28T09:13:55.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T09:13:55.076 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T09:13:59.886 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc1e08b6e80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc1dffb33a0>, signals=[15])
2023-07-28T09:13:59.888 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging
2023-07-28T09:13:59.888 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server
2023-07-28T09:13:59.889 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2023-07-28T09:13:59.908 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2023-07-28T09:13:59.908 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2023-07-28T09:13:59.909 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-07-28T09:13:59.910 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"}
2023-07-28T09:13:59.933 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"}
2023-07-28T09:13:59.982 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-28T09:14:00.005 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-28T09:14:00.023 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-28T09:14:00.023 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5}
2023-07-28T09:14:00.043 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-28T09:14:00.043 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 5}
2023-07-28T09:14:00.072 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6
2023-07-28T09:14:00.072 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-07-28T09:14:00.087 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6
2023-07-28T09:14:00.087 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:14:00.117 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"}
2023-07-28T09:14:00.124 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"}
2023-07-28T09:14:00.157 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1}
2023-07-28T09:14:00.168 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1}
2023-07-28T09:14:00.213 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-07-28T09:14:00.215 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:14:00.295 INFO:teuthology.orchestra.console.smithi022:Power off
2023-07-28T09:14:00.296 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T09:14:00.310 INFO:teuthology.orchestra.console.smithi186:Power off
2023-07-28T09:14:00.311 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T09:14:00.319 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2023-07-28T09:14:00.319 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:00.331 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2023-07-28T09:14:00.332 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:00.341 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2023-07-28T09:14:00.353 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-07-28T09:14:04.344 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:04.354 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:05.453 DEBUG:teuthology.orchestra.console.smithi022:check power output: 
2023-07-28T09:14:05.463 DEBUG:teuthology.orchestra.console.smithi186:check power output: 
2023-07-28T09:14:09.455 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:09.466 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:10.568 DEBUG:teuthology.orchestra.console.smithi022:check power output: 
2023-07-28T09:14:10.576 DEBUG:teuthology.orchestra.console.smithi186:check power output: 
2023-07-28T09:14:14.570 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:14.578 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:14.687 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-07-28T09:14:14.788 INFO:teuthology.orchestra.console.smithi186:Power off completed
2023-07-28T09:14:14.889 INFO:teuthology.orchestra.console.smithi186:Power on
2023-07-28T09:14:14.889 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-28T09:14:14.912 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On
2023-07-28T09:14:14.913 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:14.937 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-07-28T09:14:15.680 DEBUG:teuthology.orchestra.console.smithi022:check power output: 
2023-07-28T09:14:18.940 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:19.682 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:19.791 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-07-28T09:14:19.892 INFO:teuthology.orchestra.console.smithi022:Power off completed
2023-07-28T09:14:19.994 INFO:teuthology.orchestra.console.smithi022:Power on
2023-07-28T09:14:19.994 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-28T09:14:20.017 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On
2023-07-28T09:14:20.018 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:20.039 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-07-28T09:14:20.049 DEBUG:teuthology.orchestra.console.smithi186:check power output: 
2023-07-28T09:14:24.040 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:24.049 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:24.149 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-07-28T09:14:25.158 DEBUG:teuthology.orchestra.console.smithi186:check power output: 
2023-07-28T09:14:28.154 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:29.160 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:29.263 DEBUG:teuthology.orchestra.console.smithi022:check power output: 
2023-07-28T09:14:29.270 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-07-28T09:14:29.371 INFO:teuthology.orchestra.console.smithi186:Power on completed
2023-07-28T09:14:29.472 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2023-07-28T09:14:29.472 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:14:44.481 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:45.591 DEBUG:teuthology.orchestra.console.smithi022:check power output: 
2023-07-28T09:14:49.592 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:50.704 DEBUG:teuthology.orchestra.console.smithi022:check power output: 
2023-07-28T09:14:54.705 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:14:54.815 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2023-07-28T09:14:54.916 INFO:teuthology.orchestra.console.smithi022:Power on completed
2023-07-28T09:14:55.017 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2023-07-28T09:14:55.017 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-07-28T09:15:00.024 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:15:05.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:15:08.144 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-07-28T09:15:14.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:15:20.087 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:15:40.165 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:16:00.244 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:16:15.317 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:16:19.156 WARNING:teuthology.provision.fog.smithi022:timed out
2023-07-28T09:16:25.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:16:25.240 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: Authentication failed.
2023-07-28T09:16:25.241 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-28T09:16:25.244 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-28T09:16:25.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:26.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:27.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:28.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:29.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:30.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:30.403 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:16:31.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:32.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:33.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:34.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:35.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:36.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:37.299 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:38.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:39.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:40.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:41.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:42.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:43.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:44.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:45.337 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:45.474 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:16:46.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:47.544 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:48.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:49.554 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:50.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:51.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:52.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:53.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:54.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:55.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:56.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:57.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:58.600 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:16:59.605 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:00.609 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:01.602 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:17:01.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:02.619 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:03.624 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:04.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:05.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:06.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:07.644 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:08.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:09.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:10.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:11.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:12.669 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:13.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:14.679 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:15.684 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:16.661 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None
2023-07-28T09:17:16.688 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:16.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:17:17.694 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:18.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:19.704 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:19.792 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-28T09:17:20.710 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:21.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:22.721 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:23.726 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:24.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:25.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-28T09:17:25.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:17:28.848 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-28T09:17:34.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:17:37.904 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-28T09:17:43.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:17:46.960 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-28T09:17:52.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:17:56.016 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-28T09:18:02.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:18:10.096 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-07-28T09:18:16.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:19:14.544 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-28T09:19:14.545 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi022
2023-07-28T09:19:16.100 WARNING:teuthology.provision.fog.smithi186:timed out
2023-07-28T09:19:22.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:19:27.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2023-07-28T09:19:27.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T09:19:32.329 DEBUG:teuthology.orchestra.run.smithi022:> true
2023-07-28T09:19:32.448 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-28T09:19:32.448 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-28T09:19:32.743 INFO:teuthology.provision.fog.smithi186:Node is ready
2023-07-28T09:19:32.744 DEBUG:teuthology.orchestra.run.smithi186:> hostname
2023-07-28T09:19:32.762 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186
2023-07-28T09:19:32.762 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186 /etc/hosts
2023-07-28T09:19:32.817 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2023-07-28T09:19:32.818 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-07-28T09:19:32.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com'
2023-07-28T09:19:32.823 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-28T09:19:32.824 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-28T09:19:32.868 INFO:teuthology.provision.fog.smithi022:Node is ready
2023-07-28T09:19:32.868 DEBUG:teuthology.orchestra.run.smithi022:> hostname
2023-07-28T09:19:32.916 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2023-07-28T09:19:32.917 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts
2023-07-28T09:19:32.929 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hosts
2023-07-28T09:19:32.958 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts
2023-07-28T09:19:32.968 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-07-28T09:19:32.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2023-07-28T09:19:33.026 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186/smithi186/g' /etc/hostname
2023-07-28T09:19:33.093 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186
2023-07-28T09:19:33.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts
2023-07-28T09:19:33.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts
2023-07-28T09:19:33.159 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release
2023-07-28T09:19:33.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname
2023-07-28T09:19:33.215 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux"
2023-07-28T09:19:33.216 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)"
2023-07-28T09:19:33.216 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel"
2023-07-28T09:19:33.216 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora"
2023-07-28T09:19:33.216 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6"
2023-07-28T09:19:33.216 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-28T09:19:33.217 INFO:teuthology.orchestra.run.smithi186.stdout:
2023-07-28T09:19:33.218 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-28T09:19:33.218 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-28T09:19:33.218 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-28T09:19:33.218 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-28T09:19:33.219 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2023-07-28T09:19:33.220 DEBUG:teuthology.parallel:result is None
2023-07-28T09:19:33.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2023-07-28T09:19:33.308 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2023-07-28T09:19:33.356 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu"
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="22.04"
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=jammy
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian
2023-07-28T09:19:33.357 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-28T09:19:33.358 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-28T09:19:33.358 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-28T09:19:33.358 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-28T09:19:33.358 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=jammy
2023-07-28T09:19:33.359 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi022's OS to be rhel 8.6 but found ubuntu 22.04
2023-07-28T09:19:33.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T09:19:33.360 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T09:19:33.440 INFO:teuthology.nuke:Checking targets against current locks
2023-07-28T09:19:33.495 DEBUG:teuthology.nuke:shortname: smithi022
2023-07-28T09:19:33.495 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-28T09:19:33.519 DEBUG:teuthology.nuke:shortname: smithi186
2023-07-28T09:19:33.519 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-28T09:19:33.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 09:13:54.230313', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ8ddGUTt1kOXOb8BwAvFozas6lJA6iCjYVGP0bBB+gOqAburbROP0DY49n/q39lOGdDwGtnwoosdK7fu165ZsE9NIoeqvTOorLZ3hJd9ImGZzT4bvrZI0kbhQtRqNGWO2PnO1wd9ZYSkR1cAPkaVbuTd9rW5nzbPdSi476ZzD/duVK2pEEqwIITEdtIkwrSJ7Wo0+JqdgH4VMplPyFM7pArgzdM75wNoZqrnu6rnyjTrJ0KZxMYvT+LNjBUgd90/JP7RmOcYUz/rXGUnfVI/0eo8ey3idHtAWu/krn1NpY8id0/caswrSA5fRQDLwtlD1oP776Z7dt6dhvpjkwQuWbqqRBxPCclcL5OMzgvzCrbAGrQTHC5JjX/VsD3V3/d+582u1DsF6u7Uf+Zfhjh4685QThdwv2fobvFnBNOCNVce9l3d7Yt1OdtPKUkx5TIwH2XB1Rny07QI7kfQFCJyUqrmQgHFUqEQLKSYTqTMHyTyAlmK6wv9F0iJFmLEl0U8='}
2023-07-28T09:19:33.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-28_06:48:51-fs-wip-vshankar-testing-20230727.111459-testing-default-smithi/7355021', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 09:13:54.232132', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-07-28T09:19:38.578 INFO:teuthology.orchestra.console.smithi022:Power off
2023-07-28T09:19:38.579 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T09:19:38.615 INFO:teuthology.orchestra.console.smithi186:Power off
2023-07-28T09:19:38.616 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T09:19:43.641 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off
2023-07-28T09:19:43.642 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:19:44.652 DEBUG:teuthology.orchestra.console.smithi186:check power output: 
2023-07-28T09:19:48.608 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2023-07-28T09:19:48.608 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:19:48.635 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2023-07-28T09:19:48.653 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:19:48.763 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on
2023-07-28T09:19:52.638 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:19:52.748 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2023-07-28T09:19:52.765 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:19:52.875 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off
2023-07-28T09:19:52.977 INFO:teuthology.orchestra.console.smithi186:Power off completed
2023-07-28T09:19:58.084 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T09:20:03.127 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-07-28T09:20:03.149 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com
2023-07-28T09:20:03.229 INFO:teuthology.orchestra.console.smithi022:Power off completed
2023-07-28T09:20:13.390 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com
2023-07-28T09:20:23.674 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi022's OS to be rhel 8.6 but found ubuntu 22.04