2024-03-29T02:50:08.031 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-29T02:50:08.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:50:08.233 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fece5bf2c10>, signals=[15]) 2024-03-29T02:50:08.233 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2024-03-29T02:50:08.233 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2024-03-29T02:50:08.234 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-03-29T02:50:08.251 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-03-29T02:50:08.251 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-03-29T02:50:08.252 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-03-29T02:50:08.267 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2024-03-29T02:50:08.267 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2024-03-29T02:50:08.267 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-03-29T02:50:08.284 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-03-29T02:50:08.284 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-03-29T02:50:08.284 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-03-29T02:50:08.367 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-29T02:50:08.406 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-29T02:50:08.410 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-29T02:50:08.415 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of ubuntu 22.04 2024-03-29T02:50:08.416 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-29T02:50:08.456 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of ubuntu 22.04 2024-03-29T02:50:08.459 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of ubuntu 22.04 2024-03-29T02:50:08.462 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of ubuntu 22.04 2024-03-29T02:50:08.667 INFO:teuthology.orchestra.console.smithi098:Power off 2024-03-29T02:50:08.668 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:50:08.695 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-03-29T02:50:08.695 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:08.714 INFO:teuthology.orchestra.console.smithi179:Power off 2024-03-29T02:50:08.714 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:50:08.729 INFO:teuthology.orchestra.console.smithi116:Power off 2024-03-29T02:50:08.729 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:50:08.736 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-29T02:50:08.737 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-03-29T02:50:08.737 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:08.750 INFO:teuthology.orchestra.console.smithi112:Power off 2024-03-29T02:50:08.751 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:50:08.759 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-03-29T02:50:08.760 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:08.766 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-29T02:50:08.773 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-03-29T02:50:08.773 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:08.782 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-03-29T02:50:08.799 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-29T02:50:08.883 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-03-29T02:50:08.984 INFO:teuthology.orchestra.console.smithi116:Power on 2024-03-29T02:50:08.984 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-29T02:50:09.013 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2024-03-29T02:50:09.013 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:09.037 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-03-29T02:50:12.738 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:12.767 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:12.799 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:12.848 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-29T02:50:12.878 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-29T02:50:12.910 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-29T02:50:13.038 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:13.149 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-03-29T02:50:16.852 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:16.879 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:16.910 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:16.962 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-29T02:50:16.988 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-29T02:50:17.020 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-29T02:50:17.063 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-03-29T02:50:17.089 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-03-29T02:50:17.121 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-03-29T02:50:17.150 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:17.165 INFO:teuthology.orchestra.console.smithi098:Power on 2024-03-29T02:50:17.165 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-29T02:50:17.187 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On 2024-03-29T02:50:17.187 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:17.194 INFO:teuthology.orchestra.console.smithi179:Power on 2024-03-29T02:50:17.195 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-29T02:50:17.210 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-29T02:50:17.218 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-03-29T02:50:17.218 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:17.225 INFO:teuthology.orchestra.console.smithi112:Power on 2024-03-29T02:50:17.226 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-29T02:50:17.240 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-29T02:50:17.247 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-03-29T02:50:17.247 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:17.270 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-29T02:50:17.377 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-03-29T02:50:17.478 INFO:teuthology.orchestra.console.smithi116:Power on completed 2024-03-29T02:50:17.579 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2024-03-29T02:50:21.214 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:21.241 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:21.272 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:21.323 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-29T02:50:21.351 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-29T02:50:21.381 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-29T02:50:25.326 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:25.352 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:25.382 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:50:25.437 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-29T02:50:25.462 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-29T02:50:25.491 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-29T02:50:25.538 INFO:teuthology.orchestra.console.smithi098:Power on completed 2024-03-29T02:50:25.563 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-03-29T02:50:25.591 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-03-29T02:50:25.639 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2024-03-29T02:50:25.664 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-03-29T02:50:25.693 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-03-29T02:50:40.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:50:43.870 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:50:49.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:50:52.930 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:50:58.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:02.014 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:51:08.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:11.070 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:51:17.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:20.126 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:51:26.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:29.185 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:51:35.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:38.242 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:51:44.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:47.330 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:51:53.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:51:56.414 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:52:02.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:52:08.514 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:52:14.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:52:17.602 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98 2024-03-29T02:52:23.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:52:23.748 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:52:27.882 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:52:34.980 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:52:45.073 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:52:58.208 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:53:14.342 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:53:18.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:53:18.973 ERROR:teuthology.orchestra.connection:Error authenticating with smithi116.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-29T02:53:41.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:53:41.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:53:44.866 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-29T02:53:44.867 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:53:50.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:53:50.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:53:53.950 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-29T02:53:53.951 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:53:59.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:53:59.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:03.006 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-29T02:54:03.007 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:54:09.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:09.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:12.062 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-29T02:54:12.063 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:54:18.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:18.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:21.118 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:54:21.118 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-29T02:54:22.976 WARNING:teuthology.provision.fog.smithi116:timed out 2024-03-29T02:54:27.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:27.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:28.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:30.178 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:54:30.179 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-29T02:54:32.034 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:54:33.346 WARNING:teuthology.provision.fog.smithi098:timed out 2024-03-29T02:54:36.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:36.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:38.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:39.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:41.086 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:54:47.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:50.142 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:54:54.494 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:54:56.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:54:56.146 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:55:00.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:02.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:02.149 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:55:03.550 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:55:08.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:08.152 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:55:09.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:11.161 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-29T02:55:11.161 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-29T02:55:12.606 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:55:14.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:14.154 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:55:18.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:18.609 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:55:20.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:20.158 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:55:21.491 INFO:teuthology.provision.fog.smithi098:Node is ready 2024-03-29T02:55:21.491 DEBUG:teuthology.orchestra.run.smithi098:> hostname 2024-03-29T02:55:21.509 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2024-03-29T02:55:21.509 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts 2024-03-29T02:55:21.567 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2024-03-29T02:55:21.567 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-03-29T02:55:21.697 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts 2024-03-29T02:55:21.727 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts 2024-03-29T02:55:21.796 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname 2024-03-29T02:55:21.864 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098 2024-03-29T02:55:21.932 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-03-29T02:55:21.986 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-03-29T02:55:21.986 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-03-29T02:55:21.986 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-03-29T02:55:21.986 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-03-29T02:55:21.986 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-29T02:55:21.987 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-29T02:55:21.990 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi098's OS to be ubuntu 22.04 but found centos 9 2024-03-29T02:55:21.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-29T02:55:22.269 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dd507a9aa3ac46bbb59706fb9e7bc0a9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi098's OS to be ubuntu 22.04 but found centos 9 2024-03-29T02:55:22.271 INFO:teuthology.nuke:Checking targets against current locks 2024-03-29T02:55:22.328 DEBUG:teuthology.nuke:shortname: smithi098 2024-03-29T02:55:22.328 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T02:55:22.349 DEBUG:teuthology.nuke:shortname: smithi112 2024-03-29T02:55:22.349 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T02:55:22.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628840', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 02:50:27.368762', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJjNLEZ+F/NcJkC1DsPPUBNe3hLhVLVEto87DclG4NfyiF2jOIvt538GRaURMYBQfB6lxkzvN1H8xzZo0gOKmXE='} 2024-03-29T02:55:22.370 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 02:50:06.894985', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5YBFrCIeDxkJn0X8m4qG37m83+JQWlH8NgbWchd8e91rz9rldpd/rrrTsvRmTBskAuNEpHIy1eMNgbDEJAmFQ='} 2024-03-29T02:55:22.374 DEBUG:teuthology.nuke:shortname: smithi116 2024-03-29T02:55:22.374 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T02:55:22.380 DEBUG:teuthology.nuke:shortname: smithi179 2024-03-29T02:55:22.380 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-29T02:55:22.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 02:50:06.889428', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGLGKFr04UqM0dcSNR3Y2faGyiAhd2hm1S0FvbBruZpDFuoeEbRmw2fidw5WADtllGHIf6YDmwj3y0z4NctY8aA='} 2024-03-29T02:55:22.401 INFO:teuthology.orchestra.console.smithi098:Power off 2024-03-29T02:55:22.402 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:55:22.418 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-03-28_21:32:02-powercycle-squid-distro-default-smithi/7628839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-29 02:50:06.892598', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI1MnCLEhzoClwEn2LovAeWLsJDP4STVb7KGseNvOT0pyOSI8VwksZINrkaUm5O00lMAyyMcyUWiIxKITcjZp34='} 2024-03-29T02:55:22.427 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off 2024-03-29T02:55:22.428 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:22.446 INFO:teuthology.orchestra.console.smithi112:Power off 2024-03-29T02:55:22.446 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:55:22.459 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-29T02:55:22.469 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-03-29T02:55:22.469 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:22.485 INFO:teuthology.orchestra.console.smithi116:Power off 2024-03-29T02:55:22.485 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:55:22.498 INFO:teuthology.orchestra.console.smithi179:Power off 2024-03-29T02:55:22.498 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-29T02:55:22.508 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-29T02:55:22.508 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-03-29T02:55:22.508 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:22.522 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-03-29T02:55:22.522 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:22.532 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-03-29T02:55:22.546 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-29T02:55:24.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:24.612 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-29T02:55:26.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:26.160 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-03-29T02:55:26.460 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:26.509 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:26.534 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:26.547 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:26.570 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-29T02:55:26.622 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-29T02:55:26.643 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-03-29T02:55:26.660 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-29T02:55:30.571 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:30.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:30.623 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:30.644 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:30.661 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:30.682 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on 2024-03-29T02:55:30.735 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-29T02:55:30.754 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-03-29T02:55:30.770 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-29T02:55:30.855 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-03-29T02:55:30.871 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-03-29T02:55:31.006 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com 2024-03-29T02:55:31.037 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2024-03-29T02:55:32.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-29T02:55:34.684 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:34.736 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-29T02:55:34.795 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off 2024-03-29T02:55:34.849 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-29T02:55:34.896 INFO:teuthology.orchestra.console.smithi098:Power off completed 2024-03-29T02:55:34.950 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-03-29T02:55:35.038 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2024-03-29T02:55:35.088 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2024-03-29T02:55:35.538 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi098's OS to be ubuntu 22.04 but found centos 9