2023-11-06T15:33:47.596 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-06T15:33:47.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T15:33:47.737 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6caa085b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6caab89670>, signals=[15])
2023-11-06T15:33:47.738 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2023-11-06T15:33:47.739 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2023-11-06T15:33:47.739 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-11-06T15:33:47.757 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging
2023-11-06T15:33:47.758 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server
2023-11-06T15:33:47.758 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server
2023-11-06T15:33:47.760 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"}
2023-11-06T15:33:47.782 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"}
2023-11-06T15:33:47.838 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-06T15:33:47.847 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-06T15:33:47.876 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_centos_8.stream (ID 3)
2023-11-06T15:33:47.877 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 3}
2023-11-06T15:33:47.886 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_8.stream (ID 3)
2023-11-06T15:33:47.886 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 3}
2023-11-06T15:33:47.923 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of centos 8.stream
2023-11-06T15:33:47.923 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:33:47.935 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 8.stream
2023-11-06T15:33:47.935 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:33:47.973 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"}
2023-11-06T15:33:47.977 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"}
2023-11-06T15:33:48.018 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1}
2023-11-06T15:33:48.022 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1}
2023-11-06T15:33:48.072 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:33:48.075 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:33:48.156 INFO:teuthology.orchestra.console.smithi069:Power off
2023-11-06T15:33:48.157 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T15:33:48.171 INFO:teuthology.orchestra.console.smithi033:Power off
2023-11-06T15:33:48.172 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T15:33:48.179 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off
2023-11-06T15:33:48.180 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:48.193 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2023-11-06T15:33:48.193 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:48.201 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2023-11-06T15:33:48.214 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-11-06T15:33:52.206 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:52.217 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:52.317 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2023-11-06T15:33:52.326 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-11-06T15:33:56.322 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:56.329 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:56.432 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2023-11-06T15:33:56.438 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-11-06T15:33:56.533 INFO:teuthology.orchestra.console.smithi069:Power off completed
2023-11-06T15:33:56.539 INFO:teuthology.orchestra.console.smithi033:Power off completed
2023-11-06T15:33:56.635 INFO:teuthology.orchestra.console.smithi069:Power on
2023-11-06T15:33:56.635 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-06T15:33:56.643 INFO:teuthology.orchestra.console.smithi033:Power on
2023-11-06T15:33:56.644 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-06T15:33:56.657 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On
2023-11-06T15:33:56.659 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:56.667 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On
2023-11-06T15:33:56.667 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:33:56.682 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2023-11-06T15:33:56.691 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-11-06T15:34:00.686 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:34:00.693 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:34:00.796 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off
2023-11-06T15:34:00.803 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-11-06T15:34:04.799 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:34:04.806 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T15:34:04.909 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on
2023-11-06T15:34:04.915 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-11-06T15:34:05.011 INFO:teuthology.orchestra.console.smithi069:Power on completed
2023-11-06T15:34:05.016 INFO:teuthology.orchestra.console.smithi033:Power on completed
2023-11-06T15:34:05.112 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish
2023-11-06T15:34:05.113 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:34:05.118 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2023-11-06T15:34:05.118 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:34:20.198 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:34:20.200 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:34:35.283 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:34:35.286 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:34:50.362 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:34:50.364 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:35:05.442 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:35:05.444 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:35:20.509 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:35:20.511 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:35:35.586 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:35:35.588 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:35:50.662 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:35:50.664 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:36:05.746 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:36:05.748 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:36:20.819 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-11-06T15:36:20.821 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:36:20.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:36:21.181 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:36:35.882 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None
2023-11-06T15:36:35.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:36:39.006 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:36:45.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:36:48.062 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:36:54.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:36:57.146 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:36:59.771 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:37:03.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:37:05.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:37:06.202 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:37:08.826 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:37:12.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:37:14.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:37:15.262 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:37:21.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:37:24.318 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:37:30.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:37:33.371 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:37:39.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:14.831 WARNING:teuthology.provision.fog.smithi033:timed out
2023-11-06T15:38:20.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:23.902 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:38:29.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:32.990 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:38:38.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:39.375 WARNING:teuthology.provision.fog.smithi069:timed out
2023-11-06T15:38:42.074 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:38:45.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:48.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:48.442 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:38:51.134 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:38:54.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:57.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:38:57.502 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:39:00.186 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:39:03.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:06.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:06.554 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:39:12.286 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:39:12.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:18.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:21.370 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:39:27.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:27.502 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:39:31.070 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:39:31.633 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:39:37.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:38.723 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:39:40.122 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:39:46.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:39:46.204 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:39:48.815 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:39:50.285 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:39:57.367 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:40:01.946 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:40:07.451 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:40:18.081 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:40:20.533 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:40:36.657 ERROR:teuthology.orchestra.connection:Error authenticating with smithi069.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-06T15:40:55.546 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:41:01.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:01.790 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:41:06.042 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:41:07.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:07.802 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:41:12.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:13.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:15.098 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:41:16.858 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-11-06T15:41:21.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:22.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:24.154 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:41:30.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:41:33.214 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69
2023-11-06T15:41:39.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:42:22.862 WARNING:teuthology.provision.fog.smithi033:timed out
2023-11-06T15:42:28.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T15:42:29.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-06T15:42:29.187 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-06T15:42:29.454 INFO:teuthology.provision.fog.smithi033:Node is ready
2023-11-06T15:42:29.454 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2023-11-06T15:42:29.510 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2023-11-06T15:42:29.510 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts
2023-11-06T15:42:29.565 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2023-11-06T15:42:29.566 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-11-06T15:42:29.660 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts
2023-11-06T15:42:29.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts
2023-11-06T15:42:29.755 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname
2023-11-06T15:42:29.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-11-06T15:42:29.886 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-11-06T15:42:29.941 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-11-06T15:42:29.942 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)"
2023-11-06T15:42:29.942 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-11-06T15:42:29.942 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-11-06T15:42:29.942 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4"
2023-11-06T15:42:29.943 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-11-06T15:42:29.943 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-06T15:42:29.943 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-11-06T15:42:29.943 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-06T15:42:29.943 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-11-06T15:42:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-06T15:42:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-06T15:42:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-11-06T15:42:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-06T15:42:29.944 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-06T15:42:29.945 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-06T15:42:29.945 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-06T15:42:29.947 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi033's OS to be centos 8 but found rhel 8.4
2023-11-06T15:42:29.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T15:42:30.086 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4c363a1ba34c4a38bf4d2b57aafe340c
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi033's OS to be centos 8 but found rhel 8.4
2023-11-06T15:42:30.088 INFO:teuthology.nuke:Checking targets against current locks
2023-11-06T15:42:30.126 INFO:teuthology.nuke:Not nuking smithi033.front.sepia.ceph.com because description doesn't match: yuriw-2023-11-06_15:29:34-orch-reef-release-distro-default-smithi != /home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449353
2023-11-06T15:42:30.148 INFO:teuthology.nuke:Not nuking smithi069.front.sepia.ceph.com because description doesn't match: yuriw-2023-11-06_15:29:34-orch-reef-release-distro-default-smithi != /home/teuthworker/archive/vshankar-2023-11-06_07:50:57-fs-wip-vshankar-testing1-2023-11-02-1726-pacific-testing-default-smithi/7449353
2023-11-06T15:42:30.149 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBME7pe0fmL0lmk+o7gG2dQLiSdGnr9m0sMRh4tqFaxCF6f7l1Nsc24Vcq8vd9Sxsc51vREq/M9aM85z5RhSuIJE=
  smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBwcmuQVlKo9YYph1M+RmgF11N69XbBhTt5t2keWnEHMifeCwK/jwqsAjtYEkjw7eeWjUmu2E6FUn81gk/8ggv4=
2023-11-06T15:42:30.406 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi033's OS to be centos 8 but found rhel 8.4