2024-04-01T22:54:31.872 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T22:54:31.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T22:54:32.102 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff66a727c10>, signals=[15]) 2024-04-01T22:54:32.102 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2024-04-01T22:54:32.102 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T22:54:32.103 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-04-01T22:54:32.135 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2024-04-01T22:54:32.136 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T22:54:32.136 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-04-01T22:54:32.176 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2024-04-01T22:54:32.177 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T22:54:32.177 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-01T22:54:32.210 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2024-04-01T22:54:32.210 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T22:54:32.210 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-01T22:54:32.356 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T22:54:32.379 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T22:54:32.417 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T22:54:32.431 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T22:54:32.444 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of ubuntu 22.04 2024-04-01T22:54:32.445 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of ubuntu 22.04 2024-04-01T22:54:32.500 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of ubuntu 22.04 2024-04-01T22:54:32.537 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of ubuntu 22.04 2024-04-01T22:54:32.796 INFO:teuthology.orchestra.console.smithi022:Power off 2024-04-01T22:54:32.796 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:54:32.811 INFO:teuthology.orchestra.console.smithi053:Power off 2024-04-01T22:54:32.811 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:54:32.851 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-04-01T22:54:32.852 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:32.861 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2024-04-01T22:54:32.861 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:32.876 INFO:teuthology.orchestra.console.smithi062:Power off 2024-04-01T22:54:32.876 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:54:32.889 INFO:teuthology.orchestra.console.smithi156:Power off 2024-04-01T22:54:32.890 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:54:32.897 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:54:32.910 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-04-01T22:54:32.924 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-04-01T22:54:32.924 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:32.940 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-04-01T22:54:32.941 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:32.973 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T22:54:32.988 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-01T22:54:36.899 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:36.911 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:36.974 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:36.988 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:37.009 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:54:37.023 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-04-01T22:54:37.084 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T22:54:37.097 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-01T22:54:41.010 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:41.024 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:41.085 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:41.098 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:41.120 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:54:41.134 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-04-01T22:54:41.194 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T22:54:41.207 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-01T22:54:45.122 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.136 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.196 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.208 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.232 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-01T22:54:45.246 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-04-01T22:54:45.307 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-01T22:54:45.318 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-01T22:54:45.333 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-04-01T22:54:45.347 INFO:teuthology.orchestra.console.smithi053:Power off completed 2024-04-01T22:54:45.408 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-04-01T22:54:45.419 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-04-01T22:54:45.434 INFO:teuthology.orchestra.console.smithi022:Power on 2024-04-01T22:54:45.434 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T22:54:45.448 INFO:teuthology.orchestra.console.smithi053:Power on 2024-04-01T22:54:45.448 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T22:54:45.465 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2024-04-01T22:54:45.465 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.481 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2024-04-01T22:54:45.481 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.509 INFO:teuthology.orchestra.console.smithi062:Power on 2024-04-01T22:54:45.509 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T22:54:45.518 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-04-01T22:54:45.518 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-01T22:54:45.520 INFO:teuthology.orchestra.console.smithi156:Power on 2024-04-01T22:54:45.520 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T22:54:45.540 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2024-04-01T22:54:45.540 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.552 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2024-04-01T22:54:45.553 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:45.583 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-01T22:54:45.586 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-01T22:54:49.522 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:49.530 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:49.584 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:49.592 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:49.632 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-04-01T22:54:49.639 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-01T22:54:49.694 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-01T22:54:49.700 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T22:54:49.795 INFO:teuthology.orchestra.console.smithi156:Power on completed 2024-04-01T22:54:49.801 INFO:teuthology.orchestra.console.smithi062:Power on completed 2024-04-01T22:54:49.896 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2024-04-01T22:54:49.908 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2024-04-01T22:54:53.637 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:53.645 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:54:53.748 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-04-01T22:54:53.754 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:54:53.849 INFO:teuthology.orchestra.console.smithi053:Power on completed 2024-04-01T22:54:53.855 INFO:teuthology.orchestra.console.smithi022:Power on completed 2024-04-01T22:54:53.951 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2024-04-01T22:54:53.982 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2024-04-01T22:54:54.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:54:54.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:05.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:12.415 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:55:12.670 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:55:18.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:18.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:21.506 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:55:21.758 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:55:23.422 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:55:27.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:27.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:29.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:30.590 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:55:30.846 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:55:32.514 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:55:36.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:36.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:38.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:39.682 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:55:39.934 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:55:41.598 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:55:45.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:45.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:47.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:48.766 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:55:50.686 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:55:54.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:56.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:55:59.774 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:56:04.382 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:56:05.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:08.862 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:56:10.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:10.563 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:56:14.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:16.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:16.744 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:17.950 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:56:20.887 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:23.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:26.522 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:27.042 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:56:28.016 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:30.665 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:33.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:37.788 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:38.116 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:43.294 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:56:47.950 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:49.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:51.252 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:56:52.382 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:56:58.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:56:58.525 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:01.042 ERROR:teuthology.orchestra.connection:Error authenticating with smithi022.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:02.668 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:09.765 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:19.928 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:24.766 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:57:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:57:33.069 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:33.858 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:57:35.518 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:57:39.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:57:41.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:57:42.942 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:57:44.606 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:57:48.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:57:49.392 ERROR:teuthology.orchestra.connection:Error authenticating with smithi156.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-01T22:57:50.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:57:52.030 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-04-01T22:57:53.694 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:57:58.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:57:59.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:02.782 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-04-01T22:58:05.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:08.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:09.086 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:58:15.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:18.174 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:58:24.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:26.718 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:58:27.266 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:58:32.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:33.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:33.374 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:58:36.354 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:58:39.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:42.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:42.462 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:58:45.442 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:58:48.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:51.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:51.550 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-01T22:58:54.530 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:58:57.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:58:58.061 WARNING:teuthology.provision.fog.smithi053:timed out 2024-04-01T22:59:00.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:59:04.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:59:04.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T22:59:04.327 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T22:59:04.647 INFO:teuthology.provision.fog.smithi053:Node is ready 2024-04-01T22:59:04.647 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2024-04-01T22:59:04.662 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2024-04-01T22:59:04.662 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2024-04-01T22:59:04.718 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2024-04-01T22:59:04.718 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2024-04-01T22:59:04.854 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2024-04-01T22:59:04.894 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2024-04-01T22:59:04.966 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2024-04-01T22:59:05.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2024-04-01T22:59:05.108 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-04-01T22:59:05.164 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-04-01T22:59:05.165 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T22:59:05.166 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-04-01T22:59:05.166 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T22:59:05.166 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T22:59:05.166 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T22:59:05.169 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi053's OS to be ubuntu 22.04 but found centos 9 2024-04-01T22:59:05.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T22:59:05.490 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=57611e62ba9343408de3140b9dc93f79 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi053's OS to be ubuntu 22.04 but found centos 9 2024-04-01T22:59:05.492 INFO:teuthology.nuke:Checking targets against current locks 2024-04-01T22:59:05.614 DEBUG:teuthology.nuke:shortname: smithi022 2024-04-01T22:59:05.614 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T22:59:05.657 DEBUG:teuthology.nuke:shortname: smithi053 2024-04-01T22:59:05.657 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T22:59:05.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634433', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:54:31.617022', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE6Au1VEXF+STwBBcX5B6ou0/zL4QEKTbRCQd2ApgfLrUqzplSw4D/Tj46ZWWDeBjUdTv5Ee3hMwuC9CBfGvZiM='} 2024-04-01T22:59:05.683 INFO:teuthology.nuke:Not nuking smithi156.front.sepia.ceph.com because description doesn't match: yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi != /home/teuthworker/archive/yuriw-2024-04-01_20:57:46-rados-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634436 2024-04-01T22:59:05.702 DEBUG:teuthology.nuke:shortname: smithi062 2024-04-01T22:59:05.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-01T22:59:05.717 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634433', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:54:31.615290', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGQeaNr1T16XSmw4LPKr+XHAfBBZqZsShr+B8Yh83OmUuueVqDid/toSuABr1QfM+6c28o0MP7deYItb1LUC0Po='} 2024-04-01T22:59:05.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-01_20:57:46-fs-wip-yuri3-testing-2024-04-01-0837-squid-distro-default-smithi/7634431', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-01 22:54:30.705934', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMmgZ97vOS7DABHGUNLp+edTsEi98o2Isb1poh2ipNw3QRWsTXqGhl9blU8ofziI/QavdgvApGARs1LBGFlPiVM='} 2024-04-01T22:59:05.778 INFO:teuthology.orchestra.console.smithi022:Power off 2024-04-01T22:59:05.779 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:59:05.811 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2024-04-01T22:59:05.811 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:05.843 INFO:teuthology.orchestra.console.smithi053:Power off 2024-04-01T22:59:05.844 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:59:05.856 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:59:05.879 INFO:teuthology.orchestra.console.smithi062:Power off 2024-04-01T22:59:05.880 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T22:59:05.892 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2024-04-01T22:59:05.892 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:05.928 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-04-01T22:59:05.931 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-04-01T22:59:05.931 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:05.985 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-01T22:59:08.795 WARNING:teuthology.provision.fog.smithi022:timed out 2024-04-01T22:59:09.857 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:09.929 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:09.969 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:59:09.986 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:10.041 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-04-01T22:59:10.098 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-01T22:59:10.198 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-04-01T22:59:10.374 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2024-04-01T22:59:13.971 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:14.042 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:14.082 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2024-04-01T22:59:14.154 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-04-01T22:59:14.255 INFO:teuthology.orchestra.console.smithi053:Power off completed 2024-04-01T22:59:14.423 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2024-04-01T22:59:14.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T22:59:18.083 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T22:59:18.194 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2024-04-01T22:59:18.296 INFO:teuthology.orchestra.console.smithi022:Power off completed 2024-04-01T22:59:18.465 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2024-04-01T22:59:18.467 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5IGmLc8IvB+FQbAy1rrh8c0rnWEaUVafWaDH+xQJKuBmYAIx5YtoiUERdGaAk2AS1VCnijiTUr3Wz19k7TM6U= 2024-04-01T22:59:18.942 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-01T22:59:19.013 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi053's OS to be ubuntu 22.04 but found centos 9