2024-02-10T12:19:04.980 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-10T12:19:04.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T12:19:05.202 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa3fab0dc10>, signals=[15]) 2024-02-10T12:19:05.203 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2024-02-10T12:19:05.203 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2024-02-10T12:19:05.203 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-02-10T12:19:05.221 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-02-10T12:19:05.222 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-02-10T12:19:05.222 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-02-10T12:19:05.244 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2024-02-10T12:19:05.245 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2024-02-10T12:19:05.245 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2024-02-10T12:19:05.269 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2024-02-10T12:19:05.269 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2024-02-10T12:19:05.269 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-02-10T12:19:05.288 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging 2024-02-10T12:19:05.288 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server 2024-02-10T12:19:05.288 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-02-10T12:19:05.344 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-10T12:19:05.360 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-10T12:19:05.376 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-10T12:19:05.393 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of ubuntu 20.04 2024-02-10T12:19:05.398 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-10T12:19:05.415 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_ubuntu_20.04 (ID 2) 2024-02-10T12:19:05.418 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of ubuntu 20.04 2024-02-10T12:19:05.430 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 20.04 2024-02-10T12:19:05.438 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 20.04 2024-02-10T12:19:05.464 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of ubuntu 20.04 2024-02-10T12:19:05.822 INFO:teuthology.orchestra.console.smithi039:Power off 2024-02-10T12:19:05.823 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:19:05.840 INFO:teuthology.orchestra.console.smithi196:Power off 2024-02-10T12:19:05.840 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:19:05.853 INFO:teuthology.orchestra.console.smithi174:Power off 2024-02-10T12:19:05.853 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:19:05.866 INFO:teuthology.orchestra.console.smithi086:Power off 2024-02-10T12:19:05.867 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:19:05.880 INFO:teuthology.orchestra.console.smithi178:Power off 2024-02-10T12:19:05.880 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:19:05.887 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-02-10T12:19:05.888 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:05.899 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-02-10T12:19:05.899 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:05.907 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-02-10T12:19:05.908 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:05.916 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-02-10T12:19:05.917 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:05.924 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-10T12:19:05.924 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-02-10T12:19:05.925 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:05.933 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-10T12:19:05.934 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-10T12:19:05.941 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-10T12:19:05.948 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-02-10T12:19:06.025 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-02-10T12:19:06.034 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-02-10T12:19:06.035 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-02-10T12:19:06.042 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-02-10T12:19:06.049 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-02-10T12:19:06.126 INFO:teuthology.orchestra.console.smithi196:Power on 2024-02-10T12:19:06.127 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-10T12:19:06.136 INFO:teuthology.orchestra.console.smithi174:Power on 2024-02-10T12:19:06.136 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-10T12:19:06.143 INFO:teuthology.orchestra.console.smithi039:Power on 2024-02-10T12:19:06.143 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-10T12:19:06.149 INFO:teuthology.orchestra.console.smithi086:Power on 2024-02-10T12:19:06.149 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-10T12:19:06.159 INFO:teuthology.orchestra.console.smithi178:Power on 2024-02-10T12:19:06.160 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-10T12:19:06.169 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2024-02-10T12:19:06.170 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:06.176 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On 2024-02-10T12:19:06.177 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:06.184 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2024-02-10T12:19:06.184 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:06.193 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-02-10T12:19:06.193 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:06.204 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2024-02-10T12:19:06.204 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:06.212 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-10T12:19:06.212 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-10T12:19:06.213 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-10T12:19:06.218 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-10T12:19:06.229 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-02-10T12:19:10.217 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:10.226 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:10.235 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:10.242 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:10.250 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:10.328 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-10T12:19:10.337 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-10T12:19:10.344 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-10T12:19:10.351 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-10T12:19:10.358 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-02-10T12:19:10.445 INFO:teuthology.orchestra.console.smithi039:Power on completed 2024-02-10T12:19:10.452 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-02-10T12:19:10.546 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2024-02-10T12:19:10.553 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-02-10T12:19:14.333 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:14.340 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:14.359 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:19:14.442 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-10T12:19:14.457 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-10T12:19:14.470 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-02-10T12:19:14.543 INFO:teuthology.orchestra.console.smithi196:Power on completed 2024-02-10T12:19:14.558 INFO:teuthology.orchestra.console.smithi174:Power on completed 2024-02-10T12:19:14.570 INFO:teuthology.orchestra.console.smithi178:Power on completed 2024-02-10T12:19:14.644 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish 2024-02-10T12:19:14.659 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2024-02-10T12:19:14.672 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2024-02-10T12:19:14.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:19:17.852 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:19:23.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:19:26.940 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:19:32.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:19:36.000 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:19:42.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:19:45.084 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:19:51.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:19:54.140 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:20:00.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:20:03.196 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:20:09.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:20:12.252 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:20:18.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:20:21.308 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:20:27.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:20:30.368 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:20:36.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:20:54.717 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:21:00.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:21:03.772 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:21:09.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:21:09.908 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:21:14.036 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:21:21.175 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:21:31.305 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:21:44.432 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:22:00.559 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:22:19.688 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:22:41.824 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:22:46.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:22:49.756 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-10T12:22:55.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:22:58.812 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-10T12:23:01.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:04.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:04.896 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-10T12:23:06.912 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:23:07.868 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-10T12:23:10.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:13.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:13.952 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-10T12:23:16.924 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-10T12:23:19.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:22.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:23.004 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-10T12:23:25.984 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-10T12:23:29.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:31.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:32.064 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-10T12:23:35.036 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2024-02-10T12:23:35.044 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:23:35.045 WARNING:teuthology.provision.fog.smithi178:'connect to smithi178.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-02-10T12:23:38.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:41.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:41.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:23:41.120 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196 2024-02-10T12:23:47.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:24:41.040 WARNING:teuthology.provision.fog.smithi174:timed out 2024-02-10T12:24:41.047 WARNING:teuthology.provision.fog.smithi178:timed out 2024-02-10T12:24:43.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:24:43.553 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-02-10T12:24:47.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:24:47.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:24:47.155 WARNING:teuthology.provision.fog.smithi196:timed out 2024-02-10T12:24:47.303 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-10T12:24:47.303 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-10T12:24:47.788 INFO:teuthology.provision.fog.smithi174:Node is ready 2024-02-10T12:24:47.788 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2024-02-10T12:24:47.836 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2024-02-10T12:24:47.836 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2024-02-10T12:24:47.843 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2024-02-10T12:24:47.844 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2024-02-10T12:24:47.935 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2024-02-10T12:24:47.951 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2024-02-10T12:24:47.967 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2024-02-10T12:24:47.982 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2024-02-10T12:24:47.993 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2024-02-10T12:24:48.039 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Ubuntu" 2024-02-10T12:24:48.039 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-02-10T12:24:48.039 INFO:teuthology.orchestra.run.smithi174.stdout:ID=ubuntu 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE=debian 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="20.04" 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_CODENAME=focal 2024-02-10T12:24:48.040 INFO:teuthology.orchestra.run.smithi174.stdout:UBUNTU_CODENAME=focal 2024-02-10T12:24:48.041 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2024-02-10T12:24:48.042 DEBUG:teuthology.parallel:result is None 2024-02-10T12:24:50.112 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-02-10T12:24:53.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:24:53.417 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-10T12:24:53.418 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-10T12:24:53.900 INFO:teuthology.provision.fog.smithi196:Node is ready 2024-02-10T12:24:53.901 DEBUG:teuthology.orchestra.run.smithi196:> hostname 2024-02-10T12:24:53.907 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com 2024-02-10T12:24:53.907 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts 2024-02-10T12:24:53.958 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196 2024-02-10T12:24:53.958 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-02-10T12:24:54.074 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts 2024-02-10T12:24:54.091 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts 2024-02-10T12:24:54.151 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname 2024-02-10T12:24:54.162 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196 2024-02-10T12:24:54.172 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-02-10T12:24:54.221 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Ubuntu" 2024-02-10T12:24:54.221 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:ID=ubuntu 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE=debian 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="20.04" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_CODENAME=focal 2024-02-10T12:24:54.222 INFO:teuthology.orchestra.run.smithi196.stdout:UBUNTU_CODENAME=focal 2024-02-10T12:24:54.222 INFO:teuthology.provision.fog.smithi196:Deploy complete! 2024-02-10T12:24:54.223 DEBUG:teuthology.parallel:result is None 2024-02-10T12:24:56.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:24:58.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:01.569 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:25:07.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:10.652 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:25:16.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:19.708 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:25:25.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:28.764 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:25:34.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:37.820 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:25:43.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:46.876 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:25:47.554 WARNING:teuthology.provision.fog.smithi039:timed out 2024-02-10T12:25:52.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:53.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:25:56.115 WARNING:teuthology.provision.fog.smithi178:timed out 2024-02-10T12:26:02.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:26:02.190 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-10T12:26:02.190 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-10T12:26:02.264 INFO:teuthology.provision.fog.smithi178:Node is ready 2024-02-10T12:26:02.264 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2024-02-10T12:26:02.323 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178 2024-02-10T12:26:02.324 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178 /etc/hosts 2024-02-10T12:26:02.383 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178 smithi178 2024-02-10T12:26:02.383 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-02-10T12:26:02.454 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178/smithi178/g' /etc/hosts 2024-02-10T12:26:02.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2024-02-10T12:26:02.593 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178/smithi178/g' /etc/hostname 2024-02-10T12:26:02.662 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-02-10T12:26:02.730 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-02-10T12:26:02.787 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.6 (Ootpa)" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.6" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-10T12:26:02.788 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-02-10T12:26:02.789 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-02-10T12:26:02.789 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-02-10T12:26:02.792 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi178's OS to be ubuntu 20.04 but found rhel 8.6 2024-02-10T12:26:02.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-10T12:26:03.121 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d121101feb734702b8a1f6a8a475be76 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi178's OS to be ubuntu 20.04 but found rhel 8.6 2024-02-10T12:26:03.123 INFO:teuthology.nuke:Checking targets against current locks 2024-02-10T12:26:03.188 DEBUG:teuthology.nuke:shortname: smithi039 2024-02-10T12:26:03.189 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T12:26:03.196 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:26:03.215 DEBUG:teuthology.nuke:shortname: smithi086 2024-02-10T12:26:03.216 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T12:26:03.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-09_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi/7553838', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 12:19:03.802294', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKtLJRwxPpT6WzsEKGcDAxsScQABQK6RHIG67XOicBzbbpLUlaSrDmnaJgg4cl20vTYRMHIME6kGnAk9JrukrCQ='} 2024-02-10T12:26:03.232 DEBUG:teuthology.nuke:shortname: smithi174 2024-02-10T12:26:03.232 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T12:26:03.246 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-09_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi/7553838', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 12:19:03.800135', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2Qlysef4BIOK4VJZ96iYmjH7TVCaxqMBu4ZoqOR6Rm0Z40JlWpX/RbI/6/nDI/ANkzdeSJR3pyCw3simMXHTw='} 2024-02-10T12:26:03.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-09_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi/7553838', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 12:19:03.797685', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLTRJ4qwo3MOwqYarbEqlFa0io9/lYQZEZ85mX/KpMuVISNtYt4EVgmKGZudSwcXmCtzt1gzpka7fZjdv4YUWm0='} 2024-02-10T12:26:03.271 DEBUG:teuthology.nuke:shortname: smithi178 2024-02-10T12:26:03.271 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T12:26:03.278 INFO:teuthology.orchestra.console.smithi039:Power off 2024-02-10T12:26:03.278 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:26:03.296 DEBUG:teuthology.nuke:shortname: smithi196 2024-02-10T12:26:03.297 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-10T12:26:03.301 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2024-02-10T12:26:03.302 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:03.322 INFO:teuthology.orchestra.console.smithi086:Power off 2024-02-10T12:26:03.323 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:26:03.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-09_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi/7553838', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 12:19:03.804311', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIksGrTtJct+Gfxee8j5iw/VmXazRjrrs29CUNrmJ0WKj7R2Ar5EAcAdWPyRPCD29eV1EKVC3/Zahwj70D9UhIs='} 2024-02-10T12:26:03.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-02-09_14:22:14-upgrade:octopus-x-quincy-distro-default-smithi/7553839', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-10 12:19:04.329191', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGBktNsS2iyr8KnfgTMR8e2ZsXwH9Wr4kOCWKGS8N9NLbUDFcSdTvzNWBjL5B6hTNYWNGITubRDdQQVBwscpH1Q='} 2024-02-10T12:26:03.345 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2024-02-10T12:26:03.345 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-02-10T12:26:03.346 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:03.363 INFO:teuthology.orchestra.console.smithi174:Power off 2024-02-10T12:26:03.363 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:26:03.384 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-10T12:26:03.392 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2024-02-10T12:26:03.392 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:03.407 INFO:teuthology.orchestra.console.smithi178:Power off 2024-02-10T12:26:03.408 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:26:03.424 INFO:teuthology.orchestra.console.smithi196:Power off 2024-02-10T12:26:03.425 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-10T12:26:03.436 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-10T12:26:03.437 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-02-10T12:26:03.437 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:03.449 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-02-10T12:26:03.450 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:03.463 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-02-10T12:26:03.478 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-10T12:26:07.346 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:07.387 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:07.438 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:07.457 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2024-02-10T12:26:07.464 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:07.479 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:07.499 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-10T12:26:07.549 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2024-02-10T12:26:07.558 INFO:teuthology.orchestra.console.smithi039:Power off completed 2024-02-10T12:26:07.573 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-02-10T12:26:07.589 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-10T12:26:07.709 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2024-02-10T12:26:09.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-10T12:26:11.501 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:11.549 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:11.575 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:11.591 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:11.611 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-02-10T12:26:11.660 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2024-02-10T12:26:11.687 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-02-10T12:26:11.702 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-02-10T12:26:11.761 INFO:teuthology.orchestra.console.smithi174:Power off completed 2024-02-10T12:26:11.787 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-02-10T12:26:11.900 WARNING:teuthology.provision.fog.smithi039:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-02-10T12:26:11.919 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com 2024-02-10T12:26:11.937 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com 2024-02-10T12:26:12.252 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-02-10T12:26:15.613 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:15.703 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-10T12:26:15.724 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-02-10T12:26:15.813 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-02-10T12:26:15.825 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-02-10T12:26:15.914 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-02-10T12:26:15.986 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2024-02-10T12:26:16.069 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com 2024-02-10T12:26:16.672 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi178's OS to be ubuntu 20.04 but found rhel 8.6