2024-04-13T19:39:53.813 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-13T19:39:53.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T19:39:54.034 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2472828f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2473889c10>, signals=[15])
2024-04-13T19:39:54.034 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-04-13T19:39:54.034 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T19:39:54.035 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-04-13T19:39:54.055 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-04-13T19:39:54.056 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T19:39:54.056 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-04-13T19:39:54.086 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging
2024-04-13T19:39:54.087 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T19:39:54.087 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server
2024-04-13T19:39:54.122 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2024-04-13T19:39:54.123 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T19:39:54.123 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-04-13T19:39:54.191 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T19:39:54.214 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T19:39:54.235 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream
2024-04-13T19:39:54.255 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T19:39:54.274 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream
2024-04-13T19:39:54.284 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T19:39:54.305 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream
2024-04-13T19:39:54.338 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream
2024-04-13T19:39:54.665 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-13T19:39:54.666 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:39:54.689 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-13T19:39:54.690 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:54.719 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T19:39:54.747 INFO:teuthology.orchestra.console.smithi142:Power off
2024-04-13T19:39:54.747 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:39:54.761 INFO:teuthology.orchestra.console.smithi162:Power off
2024-04-13T19:39:54.761 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:39:54.769 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-04-13T19:39:54.770 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:54.788 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off
2024-04-13T19:39:54.788 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:54.796 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T19:39:54.811 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-13T19:39:54.811 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:39:54.819 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-04-13T19:39:54.819 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-13T19:39:54.832 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-13T19:39:54.832 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:54.853 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T19:39:54.898 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-04-13T19:39:54.920 INFO:teuthology.orchestra.console.smithi112:Power on
2024-04-13T19:39:54.920 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T19:39:54.943 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-04-13T19:39:54.943 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:54.954 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-13T19:39:54.964 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T19:39:54.998 INFO:teuthology.orchestra.console.smithi142:Power on
2024-04-13T19:39:54.999 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T19:39:55.021 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-04-13T19:39:55.022 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:55.041 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T19:39:55.055 INFO:teuthology.orchestra.console.smithi175:Power on
2024-04-13T19:39:55.055 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T19:39:55.077 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2024-04-13T19:39:55.077 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:55.100 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T19:39:58.823 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:58.932 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-04-13T19:39:58.965 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:59.043 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:59.074 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-13T19:39:59.102 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:39:59.152 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T19:39:59.175 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-04-13T19:39:59.212 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T19:39:59.276 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-04-13T19:40:02.937 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:40:03.047 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-04-13T19:40:03.153 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:40:03.212 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:40:03.268 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-13T19:40:03.370 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-13T19:40:03.370 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-04-13T19:40:03.471 INFO:teuthology.orchestra.console.smithi175:Power on completed
2024-04-13T19:40:03.474 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-04-13T19:40:03.575 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2024-04-13T19:40:03.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:03.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:06.654 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:40:06.750 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:40:07.048 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:40:07.157 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-04-13T19:40:07.258 INFO:teuthology.orchestra.console.smithi162:Power off completed
2024-04-13T19:40:07.359 INFO:teuthology.orchestra.console.smithi162:Power on
2024-04-13T19:40:07.359 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T19:40:07.384 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On
2024-04-13T19:40:07.385 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:40:07.406 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off
2024-04-13T19:40:11.411 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:40:11.520 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on
2024-04-13T19:40:11.621 INFO:teuthology.orchestra.console.smithi162:Power on completed
2024-04-13T19:40:11.722 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish
2024-04-13T19:40:11.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:12.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:12.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:14.947 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:40:15.710 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:40:15.810 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:40:20.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:21.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:21.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:24.030 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:40:24.766 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:40:24.862 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:40:30.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:30.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:33.086 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:40:33.822 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:40:33.922 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:40:39.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:39.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:39.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:42.174 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:40:42.882 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:40:42.974 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:40:48.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:48.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:48.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:51.230 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:40:51.934 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:40:52.034 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:40:57.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:57.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:40:58.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:00.286 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:41:00.990 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:41:01.118 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:41:06.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:06.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:07.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:09.342 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:41:10.174 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:41:15.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:16.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:18.398 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:41:24.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:25.406 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:41:26.430 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:41:31.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:32.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:34.462 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:41:35.490 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:41:40.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:40.591 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:41:41.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:42.560 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:41:42.814 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:41:44.716 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:41:48.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:48.695 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:41:48.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:51.729 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:41:51.838 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:41:52.831 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:41:57.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:41:57.859 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:41:59.968 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:01.924 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:02.027 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:09.156 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:10.105 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:15.008 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:19.286 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:23.240 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:31.138 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:32.376 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:39.375 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:48.507 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:42:58.511 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:43:07.600 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:43:20.609 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:43:45.746 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:43:50.141 WARNING:teuthology.provision.fog.smithi142:timed out
2024-04-13T19:43:56.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:44:06.430 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:44:12.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:44:14.094 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T19:44:14.095 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T19:44:29.604 WARNING:teuthology.provision.fog.smithi162:timed out
2024-04-13T19:44:31.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:44:34.399 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-04-13T19:44:34.399 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-04-13T19:44:34.416 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2024-04-13T19:44:34.417 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2024-04-13T19:44:34.472 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-04-13T19:44:34.472 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-13T19:44:34.619 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2024-04-13T19:44:34.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-04-13T19:44:34.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2024-04-13T19:44:34.784 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-13T19:44:34.851 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-04-13T19:44:34.906 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-04-13T19:44:34.906 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9"
2024-04-13T19:44:34.906 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-13T19:44:34.907 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T19:44:34.910 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi142's OS to be centos 8 but found centos 9
2024-04-13T19:44:34.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T19:44:34.915 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T19:44:35.197 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=855359c0d99e45279b1e7c392205f4c9
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi142's OS to be centos 8 but found centos 9
2024-04-13T19:44:35.199 INFO:teuthology.nuke:Checking targets against current locks
2024-04-13T19:44:35.262 DEBUG:teuthology.nuke:shortname: smithi112
2024-04-13T19:44:35.263 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:44:35.279 INFO:teuthology.nuke:Not nuking smithi162.front.sepia.ceph.com because description doesn't match: teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi != /home/teuthworker/archive/teuthology-2024-04-10_22:24:02-fs-reef-distro-default-smithi/7651605
2024-04-13T19:44:35.283 DEBUG:teuthology.nuke:shortname: smithi142
2024-04-13T19:44:35.283 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:44:35.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 19:39:52.715188', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA2iWicNv6E+67z0DFyoUHan+86z4KLuiJB1CnEV4+qZRu8HBPb2UKAGhcbXXgv+BAmtSIn3K+AuMvoiwmuHoxM='}
2024-04-13T19:44:35.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653273', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': False, 'locked_since': None, 'locked_by': None, 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQYlHhMWs3EiN68T5MAXn5eE9dV21QXULxlY4Dfsh5NIehaJ+BXZXl8orvRRuO9BFqGT8pP/jFUyadYViVRZrc='}
2024-04-13T19:44:35.303 ERROR:teuthology.nuke:Could not nuke {'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQYlHhMWs3EiN68T5MAXn5eE9dV21QXULxlY4Dfsh5NIehaJ+BXZXl8orvRRuO9BFqGT8pP/jFUyadYViVRZrc='}
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/nuke/__init__.py", line 294, in nuke_one
    nuke_helper(ctx, should_unlock, keep_logs, should_reboot)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/nuke/__init__.py", line 318, in nuke_helper
    check_lock.check_lock(ctx, None, check_up=False)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/check_lock.py", line 28, in check_lock
    assert status['locked'], \
AssertionError: machine smithi142.front.sepia.ceph.com is not locked
2024-04-13T19:44:35.317 DEBUG:teuthology.nuke:shortname: smithi175
2024-04-13T19:44:35.318 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:44:35.339 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-13T19:44:35.339 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:44:35.351 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653304', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 19:39:53.176517', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDa1hRa+7snW4o4YuunU9A9K0w+r9iYDro3KWpfiqh0BOgSj7EVYpLiQG6tc6cG1GFPh9yZD6cPxe3mnxqJAhqU='}
2024-04-13T19:44:35.363 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-13T19:44:35.363 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:44:35.385 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-13T19:44:35.404 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-13T19:44:35.405 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:44:35.427 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-13T19:44:35.427 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:44:35.450 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-13T19:44:35.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:44:38.690 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:44:39.386 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:44:39.451 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:44:39.501 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-13T19:44:39.561 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T19:44:39.663 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-13T19:44:39.812 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com
2024-04-13T19:44:40.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:44:43.501 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:44:43.613 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-13T19:44:43.966 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T19:44:44.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:44:47.614 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:44:47.725 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T19:44:47.746 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162
2024-04-13T19:44:47.826 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-13T19:44:47.978 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2024-04-13T19:44:47.980 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNQYlHhMWs3EiN68T5MAXn5eE9dV21QXULxlY4Dfsh5NIehaJ+BXZXl8orvRRuO9BFqGT8pP/jFUyadYViVRZrc=
  smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDR+sB0j0vRKXqrw95q4tfvi94mJhyxa7HRkwDAnym+zPTY3P0pXiAeNiDF1JkeJ8Cs6pGA9EoRrZC+IDLVrmko=
2024-04-13T19:44:48.415 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T19:44:48.490 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi142's OS to be centos 8 but found centos 9