2024-04-18T22:01:27.743 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T22:01:27.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T22:01:28.027 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f33fefcff70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3400006c10>, signals=[15])
2024-04-18T22:01:28.027 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging
2024-04-18T22:01:28.028 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T22:01:28.028 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server
2024-04-18T22:01:28.052 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-04-18T22:01:28.052 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T22:01:28.052 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-04-18T22:01:28.077 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging
2024-04-18T22:01:28.077 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T22:01:28.077 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server
2024-04-18T22:01:28.102 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2024-04-18T22:01:28.102 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T22:01:28.102 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-04-18T22:01:28.185 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T22:01:28.194 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T22:01:28.237 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T22:01:28.240 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 9.stream
2024-04-18T22:01:28.244 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream
2024-04-18T22:01:28.255 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10)
2024-04-18T22:01:28.299 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 9.stream
2024-04-18T22:01:28.312 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream
2024-04-18T22:01:28.467 DEBUG:teuthology.provision.fog.smithi152:Canceling deploy task with ID 972458
2024-04-18T22:01:28.783 INFO:teuthology.orchestra.console.smithi088:Power off
2024-04-18T22:01:28.783 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:01:28.796 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-18T22:01:28.796 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:01:28.803 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-04-18T22:01:28.804 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:28.816 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-18T22:01:28.816 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:28.822 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-04-18T22:01:28.834 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-18T22:01:28.864 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-18T22:01:28.864 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:01:28.886 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-18T22:01:28.886 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:28.905 INFO:teuthology.orchestra.console.smithi152:Power off
2024-04-18T22:01:28.906 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:01:28.914 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T22:01:28.923 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-04-18T22:01:28.927 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2024-04-18T22:01:28.927 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:28.935 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-18T22:01:28.947 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T22:01:29.016 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-18T22:01:29.024 INFO:teuthology.orchestra.console.smithi088:Power on
2024-04-18T22:01:29.024 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T22:01:29.036 INFO:teuthology.orchestra.console.smithi112:Power on
2024-04-18T22:01:29.036 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T22:01:29.046 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On
2024-04-18T22:01:29.046 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:29.053 INFO:teuthology.orchestra.console.smithi152:Power off completed
2024-04-18T22:01:29.057 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-04-18T22:01:29.057 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:29.067 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-04-18T22:01:29.078 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-18T22:01:29.117 INFO:teuthology.orchestra.console.smithi175:Power on
2024-04-18T22:01:29.117 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T22:01:29.138 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2024-04-18T22:01:29.138 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:29.154 INFO:teuthology.orchestra.console.smithi152:Power on
2024-04-18T22:01:29.154 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T22:01:29.162 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T22:01:29.174 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On
2024-04-18T22:01:29.174 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:29.194 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T22:01:33.072 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:33.079 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:33.164 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:33.181 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-04-18T22:01:33.187 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-18T22:01:33.195 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:33.273 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T22:01:33.304 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T22:01:37.185 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:37.192 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:37.274 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:37.294 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-04-18T22:01:37.300 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-18T22:01:37.305 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:01:37.383 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-18T22:01:37.396 INFO:teuthology.orchestra.console.smithi088:Power on completed
2024-04-18T22:01:37.401 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-04-18T22:01:37.413 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-18T22:01:37.484 INFO:teuthology.orchestra.console.smithi175:Power on completed
2024-04-18T22:01:37.497 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish
2024-04-18T22:01:37.502 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-04-18T22:01:37.514 INFO:teuthology.orchestra.console.smithi152:Power on completed
2024-04-18T22:01:37.585 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2024-04-18T22:01:37.614 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish
2024-04-18T22:01:52.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:01:55.742 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:01.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:04.830 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:10.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:13.886 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:19.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:22.946 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:28.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:32.030 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:38.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:41.086 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:47.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:50.142 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:02:56.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:02:59.198 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:03:05.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:03:08.254 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:03:14.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:03:32.766 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:03:38.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:03:41.145 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:03:47.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:03:47.281 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:03:51.411 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:03:58.543 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:04:08.673 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:04:21.768 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:04:37.864 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:04:54.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:04:56.993 ERROR:teuthology.orchestra.connection:Error authenticating with smithi152.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T22:04:57.694 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T22:05:03.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:06.750 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T22:05:12.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:15.806 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T22:05:21.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:24.862 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T22:05:30.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:33.918 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T22:05:39.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:39.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:42.974 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-18T22:05:43.070 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:05:48.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:49.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:52.129 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:05:53.566 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:05:55.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:58.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:05:58.174 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:05:59.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:00.830 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:06:01.182 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:06:04.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:06.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:07.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:07.230 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:06:09.886 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152
2024-04-18T22:06:10.242 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:06:13.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:15.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:16.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:16.286 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:06:19.294 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:06:22.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:25.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:25.342 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:06:28.354 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:06:31.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:34.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:34.398 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:06:37.406 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-18T22:06:40.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:43.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:43.458 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:06:48.977 WARNING:teuthology.provision.fog.smithi175:timed out
2024-04-18T22:06:49.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:52.510 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88
2024-04-18T22:06:54.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:06:55.254 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T22:06:55.255 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T22:06:55.571 INFO:teuthology.provision.fog.smithi175:Node is ready
2024-04-18T22:06:55.571 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2024-04-18T22:06:55.585 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2024-04-18T22:06:55.586 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts
2024-04-18T22:06:55.641 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2024-04-18T22:06:55.641 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-04-18T22:06:55.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts
2024-04-18T22:06:55.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts
2024-04-18T22:06:55.832 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname
2024-04-18T22:06:55.900 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-04-18T22:06:55.966 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-04-18T22:06:56.022 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2024-04-18T22:06:56.022 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9"
2024-04-18T22:06:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2024-04-18T22:06:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2024-04-18T22:06:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9"
2024-04-18T22:06:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9"
2024-04-18T22:06:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T22:06:56.023 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-04-18T22:06:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon"
2024-04-18T22:06:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T22:06:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2024-04-18T22:06:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T22:06:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T22:06:56.024 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T22:06:56.025 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2024-04-18T22:06:56.027 DEBUG:teuthology.parallel:result is None
2024-04-18T22:06:58.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:07:15.889 WARNING:teuthology.provision.fog.smithi152:timed out
2024-04-18T22:07:21.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:07:22.115 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T22:07:22.115 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T22:07:22.453 INFO:teuthology.provision.fog.smithi152:Node is ready
2024-04-18T22:07:22.453 DEBUG:teuthology.orchestra.run.smithi152:> hostname
2024-04-18T22:07:22.467 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com
2024-04-18T22:07:22.468 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts
2024-04-18T22:07:22.523 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152
2024-04-18T22:07:22.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-18T22:07:22.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts
2024-04-18T22:07:22.677 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts
2024-04-18T22:07:22.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname
2024-04-18T22:07:22.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152
2024-04-18T22:07:22.884 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release
2024-04-18T22:07:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream"
2024-04-18T22:07:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9"
2024-04-18T22:07:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos"
2024-04-18T22:07:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora"
2024-04-18T22:07:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9"
2024-04-18T22:07:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T22:07:22.940 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T22:07:22.940 INFO:teuthology.provision.fog.smithi152:Deploy complete!
2024-04-18T22:07:22.941 DEBUG:teuthology.parallel:result is None
2024-04-18T22:07:43.409 WARNING:teuthology.provision.fog.smithi112:timed out
2024-04-18T22:07:49.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:07:49.659 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T22:07:49.659 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T22:07:49.984 INFO:teuthology.provision.fog.smithi112:Node is ready
2024-04-18T22:07:49.985 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2024-04-18T22:07:49.999 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2024-04-18T22:07:49.999 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2024-04-18T22:07:50.055 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2024-04-18T22:07:50.055 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-04-18T22:07:50.154 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2024-04-18T22:07:50.181 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2024-04-18T22:07:50.252 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2024-04-18T22:07:50.323 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-04-18T22:07:50.392 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-04-18T22:07:50.450 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2024-04-18T22:07:50.450 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T22:07:50.451 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T22:07:50.451 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2024-04-18T22:07:50.453 DEBUG:teuthology.parallel:result is None
2024-04-18T22:07:58.514 WARNING:teuthology.provision.fog.smithi088:timed out
2024-04-18T22:08:04.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T22:08:04.762 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T22:08:04.763 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T22:08:05.098 INFO:teuthology.provision.fog.smithi088:Node is ready
2024-04-18T22:08:05.098 DEBUG:teuthology.orchestra.run.smithi088:> hostname
2024-04-18T22:08:05.113 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com
2024-04-18T22:08:05.113 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts
2024-04-18T22:08:05.169 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088
2024-04-18T22:08:05.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-04-18T22:08:05.275 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts
2024-04-18T22:08:05.303 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts
2024-04-18T22:08:05.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname
2024-04-18T22:08:05.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088
2024-04-18T22:08:05.503 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-18T22:08:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/"
2024-04-18T22:08:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T22:08:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-18T22:08:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-18T22:08:05.559 INFO:teuthology.provision.fog.smithi088:Deploy complete!
2024-04-18T22:08:05.559 DEBUG:teuthology.parallel:result is None
2024-04-18T22:08:06.730 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2024-04-18T22:08:06.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T22:08:07.034 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=392b8a9c837a4904bf9647ea52ed06a2
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2024-04-18T22:08:07.036 INFO:teuthology.nuke:Checking targets against current locks
2024-04-18T22:08:07.092 DEBUG:teuthology.nuke:shortname: smithi088
2024-04-18T22:08:07.093 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-18T22:08:07.110 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_21:32:03-powercycle-squid-distro-default-smithi/7662818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 22:01:26.684828', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH183ndNZ3zsx4QOueQK7Fn9JvHN+cdEiJ6ybUrtOBesCvjUrDjU2QNpNf7yhJ26nAOGz1xeQs50V0L7OkVlNKk='}
2024-04-18T22:08:07.130 DEBUG:teuthology.nuke:shortname: smithi112
2024-04-18T22:08:07.130 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-18T22:08:07.144 DEBUG:teuthology.nuke:shortname: smithi152
2024-04-18T22:08:07.145 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-18T22:08:07.151 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_21:32:03-powercycle-squid-distro-default-smithi/7662818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 22:01:26.680284', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIIRiaYFa0lxOw1xzRrqsrr1A5nQkoITQCcdPy9UTV4bfM/XjvnCcKAkMKJLjczW7/O6doh8NskyexQziRIu80g='}
2024-04-18T22:08:07.160 INFO:teuthology.orchestra.console.smithi088:Power off
2024-04-18T22:08:07.160 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:08:07.172 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_21:32:03-powercycle-squid-distro-default-smithi/7662827', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 22:07:51.668357', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPBK9mwJySAWjLbDE6b6V/XKHxbv752vA9y3FwIUE6FWbiQ4hcah/+CvnfLdPEp0nkc73sAbVgQx5w+R89WOka0='}
2024-04-18T22:08:07.177 DEBUG:teuthology.nuke:shortname: smithi175
2024-04-18T22:08:07.177 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-18T22:08:07.185 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off
2024-04-18T22:08:07.185 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:07.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_21:32:03-powercycle-squid-distro-default-smithi/7662818', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-18 22:01:26.682629', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF5Bv+mSeOPopNlw82RiKttNQnEYg4sZ4Qkfs+POLmN3PHzPKBxDmN6I5maOxyDNwgogg0g0gRqAACk4u0MUk+g='}
2024-04-18T22:08:07.213 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-18T22:08:07.214 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:08:07.226 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-04-18T22:08:07.236 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-18T22:08:07.237 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:07.256 INFO:teuthology.orchestra.console.smithi152:Power off
2024-04-18T22:08:07.257 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:08:07.268 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-18T22:08:07.283 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off
2024-04-18T22:08:07.283 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:07.297 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-18T22:08:07.297 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T22:08:07.306 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-18T22:08:07.319 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-18T22:08:07.319 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:07.340 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-18T22:08:11.227 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:11.269 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:11.307 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:11.337 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-04-18T22:08:11.341 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:11.379 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-18T22:08:11.416 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-18T22:08:11.449 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-18T22:08:15.339 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:15.380 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:15.417 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:15.449 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:15.458 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on
2024-04-18T22:08:15.490 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-18T22:08:15.526 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on
2024-04-18T22:08:15.559 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-18T22:08:15.660 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-18T22:08:15.805 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com
2024-04-18T22:08:19.458 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:19.491 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:19.527 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T22:08:19.569 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off
2024-04-18T22:08:19.600 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-18T22:08:19.636 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off
2024-04-18T22:08:19.670 INFO:teuthology.orchestra.console.smithi088:Power off completed
2024-04-18T22:08:19.701 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-18T22:08:19.737 INFO:teuthology.orchestra.console.smithi152:Power off completed
2024-04-18T22:08:19.823 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com
2024-04-18T22:08:19.848 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2024-04-18T22:08:19.888 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com
2024-04-18T22:08:20.371 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range