2024-04-16T15:19:31.218 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-16T15:19:31.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T15:19:31.388 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f057839af70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f05793fac10>, signals=[15])
2024-04-16T15:19:31.389 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging
2024-04-16T15:19:31.389 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T15:19:31.389 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server
2024-04-16T15:19:31.405 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging
2024-04-16T15:19:31.405 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T15:19:31.405 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server
2024-04-16T15:19:31.430 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging
2024-04-16T15:19:31.430 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T15:19:31.430 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server
2024-04-16T15:19:31.520 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T15:19:31.546 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T15:19:31.550 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T15:19:31.572 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 9.stream
2024-04-16T15:19:31.589 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 9.stream
2024-04-16T15:19:31.595 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of centos 9.stream
2024-04-16T15:19:31.827 INFO:teuthology.orchestra.console.smithi083:Power off
2024-04-16T15:19:31.827 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T15:19:31.842 INFO:teuthology.orchestra.console.smithi090:Power off
2024-04-16T15:19:31.842 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T15:19:31.853 INFO:teuthology.orchestra.console.smithi139:Power off
2024-04-16T15:19:31.853 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T15:19:31.861 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off
2024-04-16T15:19:31.862 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:31.870 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off
2024-04-16T15:19:31.871 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:31.883 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off
2024-04-16T15:19:31.884 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:31.893 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-04-16T15:19:31.899 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-04-16T15:19:31.911 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:19:35.898 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:35.906 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:35.913 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:36.008 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-04-16T15:19:36.014 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-04-16T15:19:36.021 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:19:40.011 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:40.019 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:40.026 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:40.121 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-04-16T15:19:40.127 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-04-16T15:19:40.136 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:19:40.228 INFO:teuthology.orchestra.console.smithi090:Power off completed
2024-04-16T15:19:40.329 INFO:teuthology.orchestra.console.smithi090:Power on
2024-04-16T15:19:40.329 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T15:19:40.351 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On
2024-04-16T15:19:40.351 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:40.371 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-04-16T15:19:44.126 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:44.137 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:44.236 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-04-16T15:19:44.245 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2024-04-16T15:19:44.338 INFO:teuthology.orchestra.console.smithi083:Power off completed
2024-04-16T15:19:44.346 INFO:teuthology.orchestra.console.smithi139:Power off completed
2024-04-16T15:19:44.372 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:44.439 INFO:teuthology.orchestra.console.smithi083:Power on
2024-04-16T15:19:44.439 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T15:19:44.447 INFO:teuthology.orchestra.console.smithi139:Power on
2024-04-16T15:19:44.447 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T15:19:44.461 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On
2024-04-16T15:19:44.462 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:44.472 DEBUG:teuthology.orchestra.console.smithi139:power on output: Chassis Power Control: Up/On
2024-04-16T15:19:44.473 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:44.481 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off
2024-04-16T15:19:44.486 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-04-16T15:19:44.497 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2024-04-16T15:19:48.486 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:48.493 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:48.500 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:19:48.602 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-04-16T15:19:48.611 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:19:48.628 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on
2024-04-16T15:19:48.703 INFO:teuthology.orchestra.console.smithi083:Power on completed
2024-04-16T15:19:48.712 INFO:teuthology.orchestra.console.smithi139:Power on completed
2024-04-16T15:19:48.729 INFO:teuthology.orchestra.console.smithi090:Power on completed
2024-04-16T15:19:48.805 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish
2024-04-16T15:19:48.813 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish
2024-04-16T15:19:48.830 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish
2024-04-16T15:20:49.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:20:49.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:20:49.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:20:52.286 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:20:52.287 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:20:52.287 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:20:58.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:20:58.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:20:58.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:01.342 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:01.374 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:21:01.374 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:07.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:07.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:07.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:10.398 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:10.430 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:21:10.430 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:16.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:16.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:16.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:19.454 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:19.486 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:21:19.486 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:25.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:25.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:25.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:28.510 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:28.542 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:21:28.542 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:34.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:34.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:34.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:37.598 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:37.599 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:21:37.599 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:43.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:43.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:43.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:46.658 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:46.686 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:46.686 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:21:52.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:52.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:52.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:21:55.742 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:21:55.746 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:21:55.746 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:22:01.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:01.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:01.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:04.830 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:22:10.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:13.886 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:22:19.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:20.066 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:22:20.318 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:22:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:26.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:26.465 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:28.324 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139
2024-04-16T15:22:30.559 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:34.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:34.417 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:37.691 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:38.238 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:22:38.548 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:44.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:45.649 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:47.294 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:22:47.786 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:53.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:22:53.440 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:55.739 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:22:57.575 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:00.919 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:04.666 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:08.870 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:14.758 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:17.052 ERROR:teuthology.orchestra.connection:Error authenticating with smithi083.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:27.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:23:44.019 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-16T15:24:10.658 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:24:16.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:19.710 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:24:24.873 WARNING:teuthology.provision.fog.smithi139:timed out
2024-04-16T15:24:25.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:30.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:37.534 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:24:43.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:44.190 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:24:46.594 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:24:50.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:50.942 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:24:52.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:55.646 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:24:56.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:24:59.998 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83
2024-04-16T15:25:01.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:25:01.790 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:25:06.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:25:06.289 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T15:25:06.289 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T15:25:07.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:25:07.806 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:25:13.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:25:16.863 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90
2024-04-16T15:25:22.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:25:26.626 INFO:teuthology.provision.fog.smithi083:Node is ready
2024-04-16T15:25:26.627 DEBUG:teuthology.orchestra.run.smithi083:> hostname
2024-04-16T15:25:26.644 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083
2024-04-16T15:25:26.644 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083 /etc/hosts
2024-04-16T15:25:26.702 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083 smithi083
2024-04-16T15:25:26.703 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2024-04-16T15:25:26.773 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083/smithi083/g' /etc/hosts
2024-04-16T15:25:26.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts
2024-04-16T15:25:26.913 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083/smithi083/g' /etc/hostname
2024-04-16T15:25:26.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083
2024-04-16T15:25:27.049 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release
2024-04-16T15:25:27.104 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream"
2024-04-16T15:25:27.104 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T15:25:27.105 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T15:25:27.106 INFO:teuthology.provision.fog.smithi083:Deploy complete!
2024-04-16T15:25:27.107 DEBUG:teuthology.parallel:result is None
2024-04-16T15:25:30.876 WARNING:teuthology.provision.fog.smithi139:timed out
2024-04-16T15:25:36.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:25:36.969 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T15:25:36.970 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T15:25:37.039 INFO:teuthology.provision.fog.smithi139:Node is ready
2024-04-16T15:25:37.039 DEBUG:teuthology.orchestra.run.smithi139:> hostname
2024-04-16T15:25:37.099 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139
2024-04-16T15:25:37.099 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139 /etc/hosts
2024-04-16T15:25:37.159 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139 smithi139
2024-04-16T15:25:37.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139
2024-04-16T15:25:37.232 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139/smithi139/g' /etc/hosts
2024-04-16T15:25:37.304 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts
2024-04-16T15:25:37.377 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139/smithi139/g' /etc/hostname
2024-04-16T15:25:37.448 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139
2024-04-16T15:25:37.519 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream"
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9"
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos"
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora"
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9"
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9"
2024-04-16T15:25:37.578 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T15:25:37.579 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T15:25:37.579 INFO:teuthology.provision.fog.smithi139:Deploy complete!
2024-04-16T15:25:37.580 DEBUG:teuthology.parallel:result is None
2024-04-16T15:26:22.867 WARNING:teuthology.provision.fog.smithi090:timed out
2024-04-16T15:26:28.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T15:26:29.137 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T15:26:29.137 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T15:26:29.490 INFO:teuthology.provision.fog.smithi090:Node is ready
2024-04-16T15:26:29.491 DEBUG:teuthology.orchestra.run.smithi090:> hostname
2024-04-16T15:26:29.512 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com
2024-04-16T15:26:29.512 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts
2024-04-16T15:26:29.573 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090
2024-04-16T15:26:29.573 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-04-16T15:26:29.723 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts
2024-04-16T15:26:29.756 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts
2024-04-16T15:26:29.827 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname
2024-04-16T15:26:29.898 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090
2024-04-16T15:26:29.965 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-16T15:26:30.023 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31"
2024-04-16T15:26:30.024 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-16T15:26:30.024 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/"
2024-04-16T15:26:30.024 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T15:26:30.024 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-16T15:26:30.024 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T15:26:30.026 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi090's OS to be centos 9 but found centos 8
2024-04-16T15:26:30.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T15:26:30.315 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bbfc468b2e7b4d60b4f48b7e5c99b100
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi090's OS to be centos 9 but found centos 8
2024-04-16T15:26:30.317 INFO:teuthology.nuke:Checking targets against current locks
2024-04-16T15:26:30.380 DEBUG:teuthology.nuke:shortname: smithi083
2024-04-16T15:26:30.380 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-16T15:26:30.383 INFO:teuthology.nuke:Not nuking smithi090.front.sepia.ceph.com because description doesn't match: ksirivad-2024-04-16_15:15:20-rados-wip-ksirivad-fix-64802-distro-default-smithi != /home/teuthworker/archive/leonidus-2024-04-16_12:36:42-fs-wip-lusov-shared-log-segment-distro-default-smithi/7658182
2024-04-16T15:26:30.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2024-04-16_15:15:20-rados-wip-ksirivad-fix-64802-distro-default-smithi/7658429', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:20:41.104283', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGCQ6bOGY76Au4l33E3FZvVky9/pXv193L8Fj/xPyWJ33MaBxlr3+JN1RusN7baorjv+WZHKk+J/TRvX8uqfDeg='}
2024-04-16T15:26:30.432 DEBUG:teuthology.nuke:shortname: smithi139
2024-04-16T15:26:30.432 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-16T15:26:30.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ksirivad-2024-04-16_15:15:20-rados-wip-ksirivad-fix-64802-distro-default-smithi/7658429', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 15:20:41.102475', 'locked_by': 'scheduled_ksirivad@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBTBHQwJKo5bX1UIkq3jF5aMR5qLSULrdA56G32hm9EHeuAZcpNcIvNZxtbQWl9zScad1ezZHHAnpIbxPwiWAEA='}
2024-04-16T15:26:30.464 INFO:teuthology.orchestra.console.smithi083:Power off
2024-04-16T15:26:30.464 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T15:26:30.489 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off
2024-04-16T15:26:30.490 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:30.512 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-04-16T15:26:30.527 INFO:teuthology.orchestra.console.smithi139:Power off
2024-04-16T15:26:30.528 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T15:26:30.552 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off
2024-04-16T15:26:30.553 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:30.578 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:26:34.514 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:34.579 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:34.625 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on
2024-04-16T15:26:34.691 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:26:38.626 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:38.692 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:38.737 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off
2024-04-16T15:26:38.804 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on
2024-04-16T15:26:38.837 INFO:teuthology.orchestra.console.smithi083:Power off completed
2024-04-16T15:26:38.983 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com
2024-04-16T15:26:42.806 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T15:26:42.916 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off
2024-04-16T15:26:43.017 INFO:teuthology.orchestra.console.smithi139:Power off completed
2024-04-16T15:26:43.166 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com
2024-04-16T15:26:43.168 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBB7CZWuvceFHXt1WhDpXt5Qsy4oP5R7WKUOLxaO4PWiHHCrsEbVzoQkDu4+/xWCSDqXIa4pBs2otlh9wb4h/R4=
2024-04-16T15:26:43.595 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi090's OS to be centos 9 but found centos 8