2024-04-07T04:06:15.360 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-07T04:06:15.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-07T04:06:15.572 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f815cee1f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f815df42c10>, signals=[15])
2024-04-07T04:06:15.572 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-04-07T04:06:15.572 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-04-07T04:06:15.573 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-04-07T04:06:15.598 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging
2024-04-07T04:06:15.599 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server
2024-04-07T04:06:15.599 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server
2024-04-07T04:06:15.623 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2024-04-07T04:06:15.623 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2024-04-07T04:06:15.623 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2024-04-07T04:06:15.648 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2024-04-07T04:06:15.648 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2024-04-07T04:06:15.648 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2024-04-07T04:06:15.717 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-04-07T04:06:15.751 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-04-07T04:06:15.768 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 20.04
2024-04-07T04:06:15.771 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-04-07T04:06:15.774 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_ubuntu_20.04 (ID 2)
2024-04-07T04:06:15.806 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of ubuntu 20.04
2024-04-07T04:06:15.835 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 20.04
2024-04-07T04:06:15.839 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of ubuntu 20.04
2024-04-07T04:06:16.063 INFO:teuthology.orchestra.console.smithi100:Power off
2024-04-07T04:06:16.064 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:06:16.077 INFO:teuthology.orchestra.console.smithi103:Power off
2024-04-07T04:06:16.077 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:06:16.089 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-04-07T04:06:16.090 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:16.104 INFO:teuthology.orchestra.console.smithi145:Power off
2024-04-07T04:06:16.104 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:06:16.111 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2024-04-07T04:06:16.111 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:16.124 INFO:teuthology.orchestra.console.smithi120:Power off
2024-04-07T04:06:16.125 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:06:16.132 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off
2024-04-07T04:06:16.132 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:16.139 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-07T04:06:16.140 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-07T04:06:16.146 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2024-04-07T04:06:16.146 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:16.154 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-07T04:06:16.167 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:06:20.142 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:20.149 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:20.156 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:20.168 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:20.252 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-07T04:06:20.258 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-07T04:06:20.264 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-07T04:06:20.277 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:06:24.255 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:24.263 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:24.269 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:24.278 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:24.365 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-07T04:06:24.371 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-07T04:06:24.377 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-07T04:06:24.386 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:06:24.471 INFO:teuthology.orchestra.console.smithi103:Power off completed
2024-04-07T04:06:24.478 INFO:teuthology.orchestra.console.smithi145:Power off completed
2024-04-07T04:06:24.572 INFO:teuthology.orchestra.console.smithi103:Power on
2024-04-07T04:06:24.573 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-07T04:06:24.580 INFO:teuthology.orchestra.console.smithi145:Power on
2024-04-07T04:06:24.581 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-07T04:06:24.594 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On
2024-04-07T04:06:24.595 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:24.602 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On
2024-04-07T04:06:24.602 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:24.614 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-07T04:06:24.624 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-07T04:06:28.369 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:28.387 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:28.479 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-07T04:06:28.496 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2024-04-07T04:06:28.580 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-04-07T04:06:28.597 INFO:teuthology.orchestra.console.smithi120:Power off completed
2024-04-07T04:06:28.615 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:28.625 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:28.681 INFO:teuthology.orchestra.console.smithi100:Power on
2024-04-07T04:06:28.682 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-07T04:06:28.697 INFO:teuthology.orchestra.console.smithi120:Power on
2024-04-07T04:06:28.697 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-07T04:06:28.705 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-04-07T04:06:28.706 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:28.718 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2024-04-07T04:06:28.718 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:28.729 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-07T04:06:28.729 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-07T04:06:28.734 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-07T04:06:28.742 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2024-04-07T04:06:32.732 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:32.738 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:32.745 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:32.752 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:32.841 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-07T04:06:32.847 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-07T04:06:32.854 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-07T04:06:32.860 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:06:32.955 INFO:teuthology.orchestra.console.smithi145:Power on completed
2024-04-07T04:06:32.961 INFO:teuthology.orchestra.console.smithi120:Power on completed
2024-04-07T04:06:33.056 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2024-04-07T04:06:33.061 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2024-04-07T04:06:33.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:06:36.190 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:06:36.842 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:36.850 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:06:36.952 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-07T04:06:36.958 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-07T04:06:37.053 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-04-07T04:06:37.059 INFO:teuthology.orchestra.console.smithi103:Power on completed
2024-04-07T04:06:37.154 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-04-07T04:06:37.159 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish
2024-04-07T04:06:37.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:06:40.290 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:06:42.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:06:45.246 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:06:46.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:06:49.374 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:06:51.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:06:54.306 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:06:55.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:06:58.430 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:00.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:03.390 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:07:04.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:07.486 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:09.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:12.446 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:07:13.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:16.546 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:18.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:21.502 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:07:22.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:25.602 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:27.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:30.558 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:07:31.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:34.690 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:36.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:39.617 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:07:40.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:43.774 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:45.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:49.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:07:52.830 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:07:58.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:08:04.130 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:08:10.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:08:11.909 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:08:17.182 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:08:17.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:08:18.044 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:22.171 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:23.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:08:25.091 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:08:29.261 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:31.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:08:31.230 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:35.368 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:39.349 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:42.464 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:52.436 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:08:52.560 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:09:05.658 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:09:08.528 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:09:21.797 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:09:27.655 ERROR:teuthology.orchestra.connection:Error authenticating with smithi120.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:09:40.940 ERROR:teuthology.orchestra.connection:Error authenticating with smithi103.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-07T04:10:19.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:22.462 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-07T04:10:23.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:26.466 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-04-07T04:10:28.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:31.518 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-07T04:10:32.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:35.522 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-04-07T04:10:37.470 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:10:37.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:40.574 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-07T04:10:41.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:43.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:44.574 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-04-07T04:10:46.526 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:10:46.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:49.630 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-07T04:10:49.658 WARNING:teuthology.provision.fog.smithi120:timed out
2024-04-07T04:10:50.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:52.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:52.674 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:10:53.630 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-04-07T04:10:55.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:55.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:58.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:10:58.690 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-07T04:10:59.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:01.730 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:11:02.686 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-04-07T04:11:04.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:07.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:07.742 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145
2024-04-07T04:11:08.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:10.782 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103
2024-04-07T04:11:11.742 WARNING:teuthology.provision.fog.smithi100:[Errno None] Unable to connect to port 22 on 172.21.15.100
2024-04-07T04:11:13.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:14.079 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:11:16.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:17.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:20.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:23.134 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:11:29.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:29.138 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:11:35.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:35.142 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:11:41.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:41.146 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:11:45.734 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-07T04:11:45.734 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-07T04:11:47.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:47.150 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2024-04-07T04:11:49.948 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-07T04:11:49.948 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-07T04:11:53.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-07T04:11:53.507 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-07T04:11:53.508 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-07T04:11:54.526 INFO:teuthology.provision.fog.smithi120:Node is ready
2024-04-07T04:11:54.527 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2024-04-07T04:11:54.574 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2024-04-07T04:11:54.574 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts
2024-04-07T04:11:54.622 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2024-04-07T04:11:54.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2024-04-07T04:11:54.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts
2024-04-07T04:11:54.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2024-04-07T04:11:54.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname
2024-04-07T04:11:54.884 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2024-04-07T04:11:54.935 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2024-04-07T04:11:54.981 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="22.04"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=jammy
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-07T04:11:54.982 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=jammy
2024-04-07T04:11:54.985 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi120's OS to be ubuntu 20.04 but found ubuntu 22.04
2024-04-07T04:11:54.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-07T04:11:55.314 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=863bd7025ace447abfdfcddf4d2372c1
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi120's OS to be ubuntu 20.04 but found ubuntu 22.04
2024-04-07T04:11:55.316 INFO:teuthology.nuke:Checking targets against current locks
2024-04-07T04:11:55.388 DEBUG:teuthology.nuke:shortname: smithi100
2024-04-07T04:11:55.388 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-07T04:11:55.404 DEBUG:teuthology.nuke:shortname: smithi103
2024-04-07T04:11:55.405 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-07T04:11:55.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-04_22:32:07-powercycle-reef-distro-default-smithi/7641180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-07 04:06:14.252085', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKeKJfTODVFqlx9DrkJf9oVx9jGcp/tGagjdqAGHeYfBeyElRrzJZZkeUCyWHzj5f39cQ1nNVlU4aBFlLr8r/Mc='}
2024-04-07T04:11:55.440 DEBUG:teuthology.nuke:shortname: smithi120
2024-04-07T04:11:55.440 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-07T04:11:55.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-04_22:32:07-powercycle-reef-distro-default-smithi/7641181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-07 04:06:24.707734', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDWrYQbkcnWMB6E6yh6KnuhLEkrYtzzvuyx4O6pVXQAbqrntMOeQqJhPzizQRVQlKs+voBpr/U8CJBjZRCp6Jyk='}
2024-04-07T04:11:55.463 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-04_22:32:07-powercycle-reef-distro-default-smithi/7641181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-07 04:06:24.705000', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBESF0hmkQm5lndqgHjrIwbAtrmqjfEWws4DKMB4AGSMBNt2E2w9xhHEwuytutdjhuMByCXCsTkMN7EAwaV3IEXA='}
2024-04-07T04:11:55.473 INFO:teuthology.orchestra.console.smithi100:Power off
2024-04-07T04:11:55.474 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:11:55.487 DEBUG:teuthology.nuke:shortname: smithi145
2024-04-07T04:11:55.488 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-07T04:11:55.497 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-04-07T04:11:55.497 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:55.517 INFO:teuthology.orchestra.console.smithi120:Power off
2024-04-07T04:11:55.517 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:11:55.533 INFO:teuthology.orchestra.console.smithi103:Power off
2024-04-07T04:11:55.534 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:11:55.544 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-04_22:32:07-powercycle-reef-distro-default-smithi/7641180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-07 04:06:14.249367', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIhMVePJG4OrvU2R0R/IM14L0vF8As/sc9EAjZX7ME7zopjjFMt3NA4gDjgsw1sPeiq7xFGvbjKhEXx3fYKcr68='}
2024-04-07T04:11:55.550 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-07T04:11:55.550 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2024-04-07T04:11:55.550 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:55.560 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off
2024-04-07T04:11:55.560 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:55.574 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:11:55.586 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-07T04:11:55.612 INFO:teuthology.orchestra.console.smithi145:Power off
2024-04-07T04:11:55.612 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-07T04:11:55.636 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off
2024-04-07T04:11:55.637 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:55.663 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-07T04:11:58.656 DEBUG:teuthology.orchestra.run:got remote process result: None
2024-04-07T04:11:59.551 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:59.575 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:59.585 DEBUG:teuthology.orchestra.run:got remote process result: None
2024-04-07T04:11:59.587 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:59.662 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-07T04:11:59.665 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:11:59.686 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:11:59.698 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-07T04:11:59.775 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-07T04:12:03.664 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:03.688 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:03.700 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:03.773 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-07T04:12:03.776 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:03.798 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2024-04-07T04:12:03.809 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on
2024-04-07T04:12:03.875 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-04-07T04:12:03.886 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on
2024-04-07T04:12:04.034 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2024-04-07T04:12:07.800 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:07.810 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:07.887 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-07T04:12:07.912 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2024-04-07T04:12:07.921 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off
2024-04-07T04:12:07.998 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off
2024-04-07T04:12:08.013 INFO:teuthology.orchestra.console.smithi120:Power off completed
2024-04-07T04:12:08.021 INFO:teuthology.orchestra.console.smithi103:Power off completed
2024-04-07T04:12:08.100 INFO:teuthology.orchestra.console.smithi145:Power off completed
2024-04-07T04:12:08.165 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2024-04-07T04:12:08.175 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com
2024-04-07T04:12:08.249 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2024-04-07T04:12:08.716 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi120's OS to be ubuntu 20.04 but found ubuntu 22.04