2024-04-13T18:53:19.735 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-13T18:53:19.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:53:19.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f6856bd0f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f6857c07c10>, signals=[15])
2024-04-13T18:53:19.937 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2024-04-13T18:53:19.937 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:19.937 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-04-13T18:53:19.963 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2024-04-13T18:53:19.963 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:19.963 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2024-04-13T18:53:19.988 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging
2024-04-13T18:53:19.988 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:19.988 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server
2024-04-13T18:53:20.013 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2024-04-13T18:53:20.013 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:20.013 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2024-04-13T18:53:20.082 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10)
2024-04-13T18:53:20.099 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_9.stream (ID 10)
2024-04-13T18:53:20.118 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10)
2024-04-13T18:53:20.123 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream
2024-04-13T18:53:20.143 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 9.stream
2024-04-13T18:53:20.159 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10)
2024-04-13T18:53:20.168 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream
2024-04-13T18:53:20.208 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream
2024-04-13T18:53:20.486 INFO:teuthology.orchestra.console.smithi017:Power off
2024-04-13T18:53:20.486 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:20.502 INFO:teuthology.orchestra.console.smithi123:Power off
2024-04-13T18:53:20.502 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:20.520 INFO:teuthology.orchestra.console.smithi146:Power off
2024-04-13T18:53:20.520 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:20.527 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:20.527 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.535 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:20.535 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.550 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-13T18:53:20.550 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:20.550 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.559 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-04-13T18:53:20.574 INFO:teuthology.orchestra.console.smithi164:Power off
2024-04-13T18:53:20.574 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:20.583 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-04-13T18:53:20.597 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:20.597 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.619 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2024-04-13T18:53:20.651 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-04-13T18:53:20.660 INFO:teuthology.orchestra.console.smithi123:Power off completed
2024-04-13T18:53:20.685 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-04-13T18:53:20.720 INFO:teuthology.orchestra.console.smithi164:Power off completed
2024-04-13T18:53:20.752 INFO:teuthology.orchestra.console.smithi017:Power on
2024-04-13T18:53:20.752 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:20.761 INFO:teuthology.orchestra.console.smithi123:Power on
2024-04-13T18:53:20.761 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:20.780 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:20.780 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.787 INFO:teuthology.orchestra.console.smithi146:Power on
2024-04-13T18:53:20.787 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:20.795 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:20.795 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.804 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-13T18:53:20.810 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:20.810 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.820 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-04-13T18:53:20.822 INFO:teuthology.orchestra.console.smithi164:Power on
2024-04-13T18:53:20.822 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:20.835 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-04-13T18:53:20.845 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:20.845 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:20.868 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2024-04-13T18:53:24.806 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:24.821 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:24.836 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:24.869 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:24.917 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-13T18:53:24.930 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-04-13T18:53:24.946 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-04-13T18:53:24.978 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2024-04-13T18:53:25.018 INFO:teuthology.orchestra.console.smithi017:Power on completed
2024-04-13T18:53:25.119 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2024-04-13T18:53:28.934 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:28.947 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:28.980 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:29.044 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-13T18:53:29.089 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2024-04-13T18:53:29.126 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-04-13T18:53:29.145 INFO:teuthology.orchestra.console.smithi123:Power on completed
2024-04-13T18:53:29.190 INFO:teuthology.orchestra.console.smithi164:Power on completed
2024-04-13T18:53:29.226 INFO:teuthology.orchestra.console.smithi146:Power on completed
2024-04-13T18:53:29.246 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2024-04-13T18:53:29.291 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2024-04-13T18:53:29.327 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish
2024-04-13T18:53:29.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:29.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:32.514 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:53:32.546 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:53:38.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:38.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:41.598 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:53:41.599 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:53:47.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:47.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:50.654 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:53:50.686 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:53:56.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:56.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:53:59.710 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:53:59.742 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:54:05.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:05.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:08.766 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:54:08.798 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:54:14.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:14.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:17.822 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:54:17.854 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:54:23.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:23.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:26.878 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:54:26.910 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:54:32.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:32.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:35.934 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:54:35.966 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:54:41.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:54:41.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:55:00.382 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:55:00.383 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:55:06.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:55:06.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:55:08.755 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:55:09.470 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:55:14.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:55:14.896 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:15.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:55:15.561 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:19.034 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:19.691 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:26.168 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:26.822 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:36.306 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:36.952 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:49.441 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:50.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:55:56.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:56:05.576 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:56:06.173 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:56:15.134 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-13T18:56:21.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:56:24.190 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-13T18:56:24.710 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:56:25.262 ERROR:teuthology.orchestra.connection:Error authenticating with smithi164.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:56:30.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:56:33.246 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-13T18:56:39.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:56:42.302 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-13T18:56:46.806 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:56:48.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:01.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:04.386 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-13T18:57:10.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:11.902 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:57:13.442 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-13T18:57:19.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:21.438 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:57:22.494 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-13T18:57:27.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:28.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:30.494 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:57:31.554 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-13T18:57:36.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:37.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:39.550 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:57:40.036 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:57:40.036 WARNING:teuthology.provision.fog.smithi146:'connect to smithi146.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-04-13T18:57:40.606 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-13T18:57:45.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:46.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:46.141 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:57:46.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:48.306 WARNING:teuthology.provision.fog.smithi017:timed out
2024-04-13T18:57:48.606 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2024-04-13T18:57:49.662 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2024-04-13T18:57:50.236 ERROR:teuthology.orchestra.connection:Error authenticating with smithi146.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T18:57:54.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:54.566 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:57:54.567 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:57:54.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:54.923 INFO:teuthology.provision.fog.smithi017:Node is ready
2024-04-13T18:57:54.923 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2024-04-13T18:57:54.938 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2024-04-13T18:57:54.939 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2024-04-13T18:57:54.995 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2024-04-13T18:57:54.995 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-13T18:57:55.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2024-04-13T18:57:55.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2024-04-13T18:57:55.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2024-04-13T18:57:55.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-13T18:57:55.355 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-13T18:57:55.410 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-04-13T18:57:55.411 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2024-04-13T18:57:55.411 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-13T18:57:55.411 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-04-13T18:57:55.411 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:57:55.411 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-13T18:57:55.411 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T18:57:55.412 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2024-04-13T18:57:55.413 DEBUG:teuthology.parallel:result is None
2024-04-13T18:57:55.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:31.843 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:58:37.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:40.894 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:58:46.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:49.950 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:58:54.610 WARNING:teuthology.provision.fog.smithi164:timed out
2024-04-13T18:58:55.666 WARNING:teuthology.provision.fog.smithi123:timed out
2024-04-13T18:58:55.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:59.006 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:59:00.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:00.919 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:59:00.919 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:59:01.167 INFO:teuthology.provision.fog.smithi164:Node is ready
2024-04-13T18:59:01.167 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2024-04-13T18:59:01.226 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164
2024-04-13T18:59:01.226 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164 /etc/hosts
2024-04-13T18:59:01.288 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2024-04-13T18:59:01.288 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2024-04-13T18:59:01.423 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164/smithi164/g' /etc/hosts
2024-04-13T18:59:01.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2024-04-13T18:59:01.524 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164/smithi164/g' /etc/hostname
2024-04-13T18:59:01.603 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2024-04-13T18:59:01.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:01.673 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Red Hat Enterprise Linux"
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8.6 (Ootpa)"
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:ID="rhel"
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="fedora"
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8.6"
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:59:01.771 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.redhat.com/"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-13T18:59:01.772 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-13T18:59:01.774 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi164's OS to be centos 9 but found rhel 8.6
2024-04-13T18:59:01.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:59:02.065 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=628c08bf92a94ead8b369c045dcaca7f
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi164's OS to be centos 9 but found rhel 8.6
2024-04-13T18:59:02.067 INFO:teuthology.nuke:Checking targets against current locks
2024-04-13T18:59:02.081 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:59:02.081 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:59:02.135 DEBUG:teuthology.nuke:shortname: smithi017
2024-04-13T18:59:02.135 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T18:59:02.157 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 18:53:18.624419', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGLS0mCFuCvuczeoGH1uHKPP+/AWa+QBJKK4MnNlWF7BlYHr1nbXGsGdpCLXuBraNHuNPLqWpQ7pOjalbWaUwp0='}
2024-04-13T18:59:02.158 DEBUG:teuthology.nuke:shortname: smithi123
2024-04-13T18:59:02.158 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T18:59:02.163 INFO:teuthology.provision.fog.smithi123:Node is ready
2024-04-13T18:59:02.163 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2024-04-13T18:59:02.177 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2024-04-13T18:59:02.178 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2024-04-13T18:59:02.179 DEBUG:teuthology.nuke:shortname: smithi146
2024-04-13T18:59:02.179 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T18:59:02.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653244', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 18:53:18.626269', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBypEVX1RGTre0J3ip4BwCCtvMbyWTY5568f3P4Zpf3rnDWSdvKTZeRBbQyc6SOz/NNUKCi3VlfUor03TACZSfI='}
2024-04-13T18:59:02.192 DEBUG:teuthology.nuke:shortname: smithi164
2024-04-13T18:59:02.192 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T18:59:02.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 18:53:19.061463', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPiqbWIaikToWNQAG3EYkAXGwTXGmCKtamx+1u3sFzZLKdHkmFpj2rapOQCb5jZeC6wiVC6iVvjAP6owUBJuZYo='}
2024-04-13T18:59:02.214 INFO:teuthology.orchestra.console.smithi017:Power off
2024-04-13T18:59:02.215 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:59:02.229 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653245', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 18:53:19.060256', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6UKh6itvNwvvs9qY1abfQN4nBkjJT2zr+djsJ/hH7gOcjHK4dOp64MpQYEvW5/IZASVvr6ru5ImADVxqeh1Zw='}
2024-04-13T18:59:02.238 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-04-13T18:59:02.238 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:02.247 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2024-04-13T18:59:02.248 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-04-13T18:59:02.259 INFO:teuthology.orchestra.console.smithi123:Power off
2024-04-13T18:59:02.260 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:59:02.271 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-13T18:59:02.281 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off
2024-04-13T18:59:02.281 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:02.298 INFO:teuthology.orchestra.console.smithi146:Power off
2024-04-13T18:59:02.298 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:59:02.313 INFO:teuthology.orchestra.console.smithi164:Power off
2024-04-13T18:59:02.314 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:59:02.323 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-13T18:59:02.323 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off
2024-04-13T18:59:02.323 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:02.336 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2024-04-13T18:59:02.337 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:02.348 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on
2024-04-13T18:59:02.355 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2024-04-13T18:59:02.362 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2024-04-13T18:59:02.382 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2024-04-13T18:59:02.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2024-04-13T18:59:02.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2024-04-13T18:59:02.581 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2024-04-13T18:59:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="CentOS Stream"
2024-04-13T18:59:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="9"
2024-04-13T18:59:02.637 INFO:teuthology.orchestra.run.smithi123.stdout:ID="centos"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="rhel fedora"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="9"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el9"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:LOGO="fedora-logo-icon"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-13T18:59:02.638 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://centos.org/"
2024-04-13T18:59:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:59:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-13T18:59:02.639 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T18:59:02.639 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2024-04-13T18:59:05.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:06.272 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:06.324 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:06.349 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:06.363 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:06.384 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-13T18:59:06.435 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-13T18:59:06.460 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off
2024-04-13T18:59:06.473 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2024-04-13T18:59:06.561 INFO:teuthology.orchestra.console.smithi146:Power off completed
2024-04-13T18:59:06.715 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com
2024-04-13T18:59:10.385 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:10.436 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:10.473 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:10.496 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-13T18:59:10.546 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on
2024-04-13T18:59:10.582 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2024-04-13T18:59:10.684 INFO:teuthology.orchestra.console.smithi164:Power off completed
2024-04-13T18:59:10.839 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com
2024-04-13T18:59:14.497 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:14.547 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:59:14.609 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-13T18:59:14.659 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off
2024-04-13T18:59:14.709 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-04-13T18:59:14.760 INFO:teuthology.orchestra.console.smithi123:Power off completed
2024-04-13T18:59:14.865 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2024-04-13T18:59:14.905 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2024-04-13T18:59:15.358 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146
2024-04-13T18:59:15.457 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi164's OS to be centos 9 but found rhel 8.6