2023-11-23T15:44:57.938 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-23T15:44:57.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T15:44:58.172 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8610ad0670>, signals=[15]) 2023-11-23T15:44:58.173 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-11-23T15:44:58.173 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T15:44:58.173 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-11-23T15:44:58.189 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-11-23T15:44:58.189 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T15:44:58.189 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-11-23T15:44:58.214 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-11-23T15:44:58.214 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T15:44:58.214 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-23T15:44:58.238 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2023-11-23T15:44:58.239 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T15:44:58.239 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2023-11-23T15:44:58.255 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-11-23T15:44:58.256 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-11-23T15:44:58.256 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-11-23T15:44:58.322 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T15:44:58.344 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T15:44:58.349 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T15:44:58.368 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream 2023-11-23T15:44:58.381 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T15:44:58.391 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_8.stream (ID 3) 2023-11-23T15:44:58.401 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream 2023-11-23T15:44:58.403 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2023-11-23T15:44:58.433 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream 2023-11-23T15:44:58.466 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream 2023-11-23T15:44:59.222 INFO:teuthology.orchestra.console.smithi084:Power off 2023-11-23T15:44:59.223 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:44:59.243 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-11-23T15:44:59.243 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:44:59.265 INFO:teuthology.orchestra.console.smithi162:Power off 2023-11-23T15:44:59.265 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:44:59.274 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-23T15:44:59.288 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-11-23T15:44:59.288 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:44:59.300 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-23T15:44:59.301 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:44:59.317 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-23T15:44:59.317 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:44:59.333 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-23T15:44:59.333 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:44:59.340 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-11-23T15:44:59.342 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-23T15:44:59.342 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:44:59.354 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-23T15:44:59.363 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-23T15:44:59.368 INFO:teuthology.orchestra.console.smithi179:Power off 2023-11-23T15:44:59.368 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:44:59.395 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-11-23T15:44:59.396 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:44:59.417 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-23T15:45:03.277 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:03.341 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:03.356 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:03.364 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:03.386 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-23T15:45:03.418 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:03.449 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-11-23T15:45:03.464 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-23T15:45:03.472 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-23T15:45:03.527 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-23T15:45:07.388 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.450 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.465 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.473 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.497 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-23T15:45:07.529 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.560 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-11-23T15:45:07.572 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-23T15:45:07.581 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-23T15:45:07.598 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-11-23T15:45:07.637 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-23T15:45:07.660 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-11-23T15:45:07.682 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-23T15:45:07.699 INFO:teuthology.orchestra.console.smithi084:Power on 2023-11-23T15:45:07.699 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T15:45:07.720 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-11-23T15:45:07.721 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.738 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-11-23T15:45:07.740 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-23T15:45:07.762 INFO:teuthology.orchestra.console.smithi162:Power on 2023-11-23T15:45:07.762 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T15:45:07.782 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2023-11-23T15:45:07.783 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.789 INFO:teuthology.orchestra.console.smithi161:Power on 2023-11-23T15:45:07.789 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T15:45:07.802 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-11-23T15:45:07.809 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-11-23T15:45:07.809 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.828 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-23T15:45:07.840 INFO:teuthology.orchestra.console.smithi179:Power on 2023-11-23T15:45:07.840 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T15:45:07.859 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-11-23T15:45:07.860 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:07.881 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-23T15:45:11.574 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:11.683 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-23T15:45:11.741 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:11.784 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-23T15:45:11.803 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:11.829 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:11.850 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-23T15:45:11.882 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:11.888 INFO:teuthology.orchestra.console.smithi112:Power on 2023-11-23T15:45:11.888 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-23T15:45:11.907 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-11-23T15:45:11.907 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:11.915 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-11-23T15:45:11.927 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-23T15:45:11.936 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-23T15:45:11.990 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-23T15:45:15.855 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:15.915 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:15.928 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:15.936 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:15.963 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-23T15:45:15.991 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:45:16.023 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-11-23T15:45:16.036 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-23T15:45:16.044 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-23T15:45:16.064 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-11-23T15:45:16.125 INFO:teuthology.orchestra.console.smithi162:Power on completed 2023-11-23T15:45:16.137 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-11-23T15:45:16.144 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-11-23T15:45:16.165 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-11-23T15:45:16.168 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-23T15:45:16.226 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2023-11-23T15:45:16.238 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-11-23T15:45:16.245 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-11-23T15:45:16.270 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-11-23T15:45:16.370 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-11-23T15:45:16.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:45:34.818 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:45:40.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:45:43.906 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:45:49.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:45:52.962 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:45:58.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:02.018 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:46:08.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:11.106 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:46:17.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:20.194 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:46:26.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:29.282 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:46:35.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:38.339 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:46:44.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:47.426 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:46:53.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:46:59.522 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:47:05.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:47:08.578 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:47:14.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:47:17.664 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2023-11-23T15:47:23.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:47:23.789 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:47:27.909 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:47:35.029 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:47:45.149 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:47:58.270 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:48:14.391 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:48:33.510 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:48:44.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:48:47.586 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:48:53.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:48:55.635 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:48:56.642 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:49:02.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:49:05.699 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:49:11.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:49:14.754 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:49:20.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:49:20.757 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:49:23.812 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:49:29.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:49:32.866 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:49:38.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:49:48.840 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:49:48.840 WARNING:teuthology.provision.fog.smithi162:'connect to smithi162.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2023-11-23T15:49:54.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:49:54.920 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:49:57.218 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:49:59.001 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:50:03.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:50:06.082 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:50:06.274 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:50:12.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:50:15.330 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-11-23T15:50:16.162 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:50:21.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:50:21.521 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T15:50:21.521 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T15:50:29.284 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:50:41.558 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-11-23T15:50:41.559 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-11-23T15:50:41.583 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2023-11-23T15:50:41.583 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2023-11-23T15:50:41.644 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-11-23T15:50:41.644 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-11-23T15:50:41.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2023-11-23T15:50:41.804 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-11-23T15:50:41.873 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2023-11-23T15:50:41.941 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-11-23T15:50:42.008 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8" 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8" 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-11-23T15:50:42.067 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-23T15:50:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-11-23T15:50:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-23T15:50:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2023-11-23T15:50:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-23T15:50:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-23T15:50:42.068 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-23T15:50:42.069 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-11-23T15:50:42.070 DEBUG:teuthology.parallel:result is None 2023-11-23T15:50:45.405 ERROR:teuthology.orchestra.connection:Error authenticating with smithi162.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-23T15:51:20.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:51:23.206 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:51:29.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:51:32.258 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:51:38.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:51:41.314 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:51:47.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:51:50.370 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:51:51.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:51:54.466 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-23T15:51:56.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:51:59.426 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:52:00.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:03.522 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-23T15:52:04.408 WARNING:teuthology.provision.fog.smithi162:timed out 2023-11-23T15:52:05.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:08.482 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:52:09.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:10.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:12.582 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-23T15:52:14.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:17.570 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:52:18.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:21.638 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-23T15:52:23.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:27.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:30.690 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-23T15:52:36.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:39.746 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-11-23T15:52:42.082 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:52:45.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:48.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:52:51.142 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-11-23T15:52:57.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:53:00.283 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T15:53:00.284 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T15:53:10.412 WARNING:teuthology.provision.fog.smithi162:timed out 2023-11-23T15:53:16.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:53:16.601 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-23T15:53:16.602 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-23T15:53:16.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:53:17.041 INFO:teuthology.provision.fog.smithi162:Node is ready 2023-11-23T15:53:17.041 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2023-11-23T15:53:17.087 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2023-11-23T15:53:17.088 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2023-11-23T15:53:17.140 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2023-11-23T15:53:17.140 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-11-23T15:53:17.260 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2023-11-23T15:53:17.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2023-11-23T15:53:17.327 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2023-11-23T15:53:17.384 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2023-11-23T15:53:17.438 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2023-11-23T15:53:17.483 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-23T15:53:17.483 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2023-11-23T15:53:17.483 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2023-11-23T15:53:17.483 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-23T15:53:17.483 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-23T15:53:17.484 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2023-11-23T15:53:17.486 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi162's OS to be centos 8 but found ubuntu 22.04 2023-11-23T15:53:17.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-23T15:53:17.654 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=004250f189d943ebab30aa38d4072648 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi162's OS to be centos 8 but found ubuntu 22.04 2023-11-23T15:53:17.656 INFO:teuthology.nuke:Checking targets against current locks 2023-11-23T15:53:17.731 DEBUG:teuthology.nuke:shortname: smithi084 2023-11-23T15:53:17.731 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:53:17.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-23_15:43:01-rados-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7464885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:44:56.977145', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC4wGOn3BwsjOrMVneiVv9jWvE80QGQ6GKkQyYR86EEFPQZ+aJNyqttYMT7hOpnXIRufdtFrRNUJiK7Xj0eLSZg='} 2023-11-23T15:53:17.758 DEBUG:teuthology.nuke:shortname: smithi112 2023-11-23T15:53:17.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:53:17.782 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-23_15:43:01-rados-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7464885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:44:56.980076', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMX9WSnAweoRUiHrhnF4vfdXfdL/I56I5UlXCj+nKB4TgheMojOuEHDa2Ua9jnoDicNFSb4sVt9t0lWX19Kb1zg='} 2023-11-23T15:53:17.787 DEBUG:teuthology.nuke:shortname: smithi161 2023-11-23T15:53:17.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:53:17.796 DEBUG:teuthology.nuke:shortname: smithi162 2023-11-23T15:53:17.796 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:53:17.805 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-23_15:43:01-rados-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7464885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:44:56.979089', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNU7SmW/v/G/Y3cq2DTPlKiE4Aj2MzQZ3RM8qGNUYd8754nBk5Fhq1M0oeA/IL2IxMWSEfKO0IWvwCw/q3p9YR8='} 2023-11-23T15:53:17.813 INFO:teuthology.orchestra.console.smithi084:Power off 2023-11-23T15:53:17.814 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:53:17.829 INFO:teuthology.orchestra.console.smithi112:Power off 2023-11-23T15:53:17.830 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:53:17.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-23_15:43:01-rados-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7464896', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:45:10.843246', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7yDojg1bwIfeINHrqrYPmoP86/ZowK0wQBf5z5QYh0M36sU/BAg52854syUgTmkQ90ClVOp3qs9PO3QMiVbHU='} 2023-11-23T15:53:17.841 DEBUG:teuthology.nuke:shortname: smithi179 2023-11-23T15:53:17.841 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-23T15:53:17.848 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-11-23T15:53:17.849 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:17.859 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-11-23T15:53:17.859 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:17.871 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-23T15:53:17.888 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-23T15:53:17.889 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:53:17.898 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-23_15:43:01-rados-wip-yuri10-testing-2023-11-22-1112-distro-default-smithi/7464885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 15:44:56.978144', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFC7NUxpkQhUPgDwXPh0DVOl9ikg2If/fcQPLcUNk5wkjVLFEPMs+WVMpeSg2cn3F0e2X55iWyoRHs69c55L+/o='} 2023-11-23T15:53:17.902 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-23T15:53:17.914 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-23T15:53:17.914 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:17.932 INFO:teuthology.orchestra.console.smithi162:Power off 2023-11-23T15:53:17.932 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:53:17.942 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-23T15:53:17.954 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2023-11-23T15:53:17.954 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:17.968 INFO:teuthology.orchestra.console.smithi179:Power off 2023-11-23T15:53:17.968 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-23T15:53:17.979 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-11-23T15:53:17.989 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-11-23T15:53:17.989 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:18.011 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-23T15:53:20.066 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-23T15:53:21.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-11-23T15:53:21.872 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:21.903 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:21.943 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:21.981 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:21.990 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-23T15:53:22.011 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:22.021 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-11-23T15:53:22.052 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-23T15:53:22.091 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2023-11-23T15:53:22.123 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-11-23T15:53:25.992 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:26.022 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:26.054 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:26.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-23T15:53:26.092 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:26.103 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-11-23T15:53:26.124 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:26.198 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-11-23T15:53:26.199 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-23T15:53:26.203 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2023-11-23T15:53:26.297 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-11-23T15:53:26.299 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-11-23T15:53:26.304 INFO:teuthology.orchestra.console.smithi162:Power off completed 2023-11-23T15:53:26.399 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-11-23T15:53:26.476 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2023-11-23T15:53:26.476 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-11-23T15:53:26.549 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2023-11-23T15:53:29.122 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-23T15:53:30.104 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:30.200 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-23T15:53:30.214 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-11-23T15:53:30.309 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-23T15:53:30.315 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-11-23T15:53:30.410 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-23T15:53:30.465 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2023-11-23T15:53:30.565 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2023-11-23T15:53:31.191 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi162's OS to be centos 8 but found ubuntu 22.04