2023-12-18T13:17:23.676 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-18T13:17:23.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-18T13:17:23.835 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f56744fe280>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5675458940>, signals=[15])
2023-12-18T13:17:23.836 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging
2023-12-18T13:17:23.836 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server
2023-12-18T13:17:23.836 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server
2023-12-18T13:17:23.867 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2023-12-18T13:17:23.867 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2023-12-18T13:17:23.867 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-12-18T13:17:23.891 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging
2023-12-18T13:17:23.891 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server
2023-12-18T13:17:23.892 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2023-12-18T13:17:23.977 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_8.stream (ID 3)
2023-12-18T13:17:24.009 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3)
2023-12-18T13:17:24.016 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream
2023-12-18T13:17:24.024 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_centos_8.stream (ID 3)
2023-12-18T13:17:24.051 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream
2023-12-18T13:17:24.061 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of centos 8.stream
2023-12-18T13:17:24.469 INFO:teuthology.orchestra.console.smithi055:Power off
2023-12-18T13:17:24.470 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-18T13:17:24.486 INFO:teuthology.orchestra.console.smithi154:Power off
2023-12-18T13:17:24.486 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-18T13:17:24.493 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off
2023-12-18T13:17:24.493 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:24.505 INFO:teuthology.orchestra.console.smithi190:Power off
2023-12-18T13:17:24.505 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-18T13:17:24.511 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-12-18T13:17:24.512 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:24.518 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2023-12-18T13:17:24.524 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2023-12-18T13:17:24.524 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:24.532 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:17:24.544 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-12-18T13:17:28.521 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:28.533 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:28.546 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:28.629 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2023-12-18T13:17:28.640 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:17:28.655 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-12-18T13:17:32.633 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:32.642 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:32.656 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:32.744 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2023-12-18T13:17:32.749 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:17:32.764 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-12-18T13:17:32.864 INFO:teuthology.orchestra.console.smithi190:Power off completed
2023-12-18T13:17:32.965 INFO:teuthology.orchestra.console.smithi190:Power on
2023-12-18T13:17:32.965 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-18T13:17:32.986 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On
2023-12-18T13:17:32.986 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:33.006 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-12-18T13:17:36.747 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:36.753 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:36.855 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2023-12-18T13:17:36.860 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-12-18T13:17:36.957 INFO:teuthology.orchestra.console.smithi055:Power off completed
2023-12-18T13:17:36.961 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-12-18T13:17:37.007 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:37.058 INFO:teuthology.orchestra.console.smithi055:Power on
2023-12-18T13:17:37.058 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-18T13:17:37.064 INFO:teuthology.orchestra.console.smithi154:Power on
2023-12-18T13:17:37.064 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-18T13:17:37.078 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On
2023-12-18T13:17:37.079 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:37.086 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2023-12-18T13:17:37.086 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:37.098 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2023-12-18T13:17:37.105 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-12-18T13:17:37.114 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-12-18T13:17:41.101 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:41.107 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:41.115 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:41.210 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2023-12-18T13:17:41.214 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:17:41.223 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-12-18T13:17:41.316 INFO:teuthology.orchestra.console.smithi154:Power on completed
2023-12-18T13:17:41.324 INFO:teuthology.orchestra.console.smithi190:Power on completed
2023-12-18T13:17:41.416 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2023-12-18T13:17:41.425 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2023-12-18T13:17:41.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:17:41.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:17:45.213 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:17:45.324 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2023-12-18T13:17:45.425 INFO:teuthology.orchestra.console.smithi055:Power on completed
2023-12-18T13:17:45.526 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish
2023-12-18T13:17:59.954 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:18:00.209 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:18:05.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:06.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:09.041 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:18:09.265 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:18:15.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:15.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:18.130 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:18:18.321 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:18:24.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:24.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:27.217 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:18:27.377 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:18:33.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:33.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:36.274 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:18:36.433 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:18:42.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:42.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:45.362 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:18:45.493 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:18:51.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:51.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:18:57.585 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:19:03.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:19:06.642 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:19:09.841 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:19:12.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:19:15.591 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:19:15.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:19:18.898 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:19:21.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:19:21.717 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:24.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:19:25.029 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:25.837 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:29.161 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:32.956 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:36.292 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:43.074 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:46.423 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:56.191 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:19:59.554 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:20:12.310 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:20:15.685 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:20:31.429 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:20:34.815 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:20:53.549 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:20:56.945 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:18.666 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:22.075 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:46.786 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:46.786 WARNING:teuthology.provision.fog.smithi190:'connect to smithi190.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-18T13:21:50.165 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:50.166 WARNING:teuthology.provision.fog.smithi154:'connect to smithi154.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-18T13:21:52.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:21:52.864 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:56.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:21:56.258 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:21:56.982 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:00.389 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:04.059 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:05.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:22:05.787 ERROR:teuthology.orchestra.connection:Error authenticating with smithi055.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:07.517 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:14.177 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:17.649 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:20.049 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2023-12-18T13:22:26.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:22:27.257 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:29.105 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2023-12-18T13:22:30.779 ERROR:teuthology.orchestra.connection:Error authenticating with smithi154.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:35.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:22:38.161 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2023-12-18T13:22:43.374 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-18T13:22:44.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:22:47.217 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2023-12-18T13:22:53.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:22:56.273 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55
2023-12-18T13:23:02.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:05.105 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:23:11.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:14.162 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:23:20.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:20.721 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:23:23.217 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:23:26.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:29.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:29.781 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:23:32.273 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-12-18T13:23:35.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:38.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:38.833 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:23:44.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:47.889 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:23:53.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:23:59.985 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:24:02.277 WARNING:teuthology.provision.fog.smithi055:timed out
2023-12-18T13:24:05.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:24:08.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:24:08.543 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-18T13:24:08.543 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-18T13:24:08.793 INFO:teuthology.provision.fog.smithi055:Node is ready
2023-12-18T13:24:08.794 DEBUG:teuthology.orchestra.run.smithi055:> hostname
2023-12-18T13:24:08.854 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com
2023-12-18T13:24:08.854 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts
2023-12-18T13:24:08.915 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055
2023-12-18T13:24:08.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2023-12-18T13:24:09.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts
2023-12-18T13:24:09.045 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:24:09.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts
2023-12-18T13:24:09.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname
2023-12-18T13:24:09.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055
2023-12-18T13:24:09.258 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31"
2023-12-18T13:24:09.317 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-18T13:24:09.318 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/"
2023-12-18T13:24:09.318 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-18T13:24:09.318 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-18T13:24:09.318 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-18T13:24:09.319 INFO:teuthology.provision.fog.smithi055:Deploy complete!
2023-12-18T13:24:09.320 DEBUG:teuthology.parallel:result is None
2023-12-18T13:24:15.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:24:18.097 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:24:24.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:24:27.153 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-12-18T13:24:33.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:24:33.657 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-18T13:24:33.657 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-18T13:24:38.277 WARNING:teuthology.provision.fog.smithi154:timed out
2023-12-18T13:24:44.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-18T13:24:44.534 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-18T13:24:44.534 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-18T13:24:44.786 INFO:teuthology.provision.fog.smithi154:Node is ready
2023-12-18T13:24:44.787 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2023-12-18T13:24:44.845 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2023-12-18T13:24:44.845 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2023-12-18T13:24:44.903 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2023-12-18T13:24:44.903 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-12-18T13:24:45.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2023-12-18T13:24:45.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2023-12-18T13:24:45.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2023-12-18T13:24:45.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-12-18T13:24:45.247 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-12-18T13:24:45.303 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux"
2023-12-18T13:24:45.303 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)"
2023-12-18T13:24:45.303 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel"
2023-12-18T13:24:45.303 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora"
2023-12-18T13:24:45.303 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6"
2023-12-18T13:24:45.303 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-18T13:24:45.304 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-18T13:24:45.306 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi154's OS to be centos 8 but found rhel 8.6
2023-12-18T13:24:45.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-18T13:24:45.450 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5afddb8478cb489e920c6a2a5bd889ba
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi154's OS to be centos 8 but found rhel 8.6
2023-12-18T13:24:45.452 INFO:teuthology.nuke:Checking targets against current locks
2023-12-18T13:24:45.498 DEBUG:teuthology.nuke:shortname: smithi055
2023-12-18T13:24:45.498 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-18T13:24:45.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-18_13:16:52-orch:cephadm-wip-adk-testing-2023-12-17-2227-distro-default-smithi/7495486', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 13:17:22.856750', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCYiEVgKNhQ0KI9yYhGf8vMMOSyXwAg9/3MDTE98rQ5D46QClLfI8z6tPSfRY35a6Yeag9Ltob0tNhZb3LTsK2E='}
2023-12-18T13:24:45.527 DEBUG:teuthology.nuke:shortname: smithi154
2023-12-18T13:24:45.527 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-18T13:24:45.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-18_13:16:52-orch:cephadm-wip-adk-testing-2023-12-17-2227-distro-default-smithi/7495487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 13:17:23.710595', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0nFV9g9iZ5pszQInjDfHzjdi7THN9B7sNiz+upV9+ZB9PubEmKzPQ/oq0r3eR0N8r9Yof0up0Nz4sOOzYJTTU='}
2023-12-18T13:24:45.550 DEBUG:teuthology.nuke:shortname: smithi190
2023-12-18T13:24:45.550 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-18T13:24:45.561 INFO:teuthology.orchestra.console.smithi055:Power off
2023-12-18T13:24:45.561 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-18T13:24:45.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-18_13:16:52-orch:cephadm-wip-adk-testing-2023-12-17-2227-distro-default-smithi/7495487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-18 13:17:23.712315', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKs7sTvby3Otll/Q4awIn5qG8tOPv+6o3b0t3/4o+Zn8XDx5JcBxM6KmdYtEcjABBLcqrkkd1DCRDWyLDR6cJJw='}
2023-12-18T13:24:45.584 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off
2023-12-18T13:24:45.584 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:45.603 INFO:teuthology.orchestra.console.smithi154:Power off
2023-12-18T13:24:45.603 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-18T13:24:45.615 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2023-12-18T13:24:45.627 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-12-18T13:24:45.627 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:45.640 INFO:teuthology.orchestra.console.smithi190:Power off
2023-12-18T13:24:45.641 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-18T13:24:45.652 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:24:45.664 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off
2023-12-18T13:24:45.664 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:45.685 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-12-18T13:24:49.360 INFO:teuthology.provision.fog.smithi190:Node is ready
2023-12-18T13:24:49.360 DEBUG:teuthology.orchestra.run.smithi190:> hostname
2023-12-18T13:24:49.382 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2023-12-18T13:24:49.382 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts
2023-12-18T13:24:49.442 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2023-12-18T13:24:49.442 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190
2023-12-18T13:24:49.593 DEBUG:teuthology.orchestra.run:got remote process result: None
2023-12-18T13:24:49.616 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:49.653 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:49.686 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:49.725 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on
2023-12-18T13:24:49.762 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:24:49.795 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-12-18T13:24:53.727 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:53.763 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:53.796 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:53.837 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off
2023-12-18T13:24:53.874 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-12-18T13:24:53.904 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on
2023-12-18T13:24:53.939 INFO:teuthology.orchestra.console.smithi055:Power off completed
2023-12-18T13:24:54.081 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com
2023-12-18T13:24:57.875 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:57.906 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-18T13:24:57.985 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-12-18T13:24:58.015 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off
2023-12-18T13:24:58.086 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-12-18T13:24:58.115 INFO:teuthology.orchestra.console.smithi190:Power off completed
2023-12-18T13:24:58.240 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com
2023-12-18T13:24:58.248 ERROR:teuthology.lock.ops:failed to unlock smithi190.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node
2023-12-18T13:24:58.627 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi154's OS to be centos 8 but found rhel 8.6