2024-04-19T00:22:04.283 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-19T00:22:04.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-19T00:22:04.484 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4071b70f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4072bd1c10>, signals=[15])
2024-04-19T00:22:04.484 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging
2024-04-19T00:22:04.484 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server
2024-04-19T00:22:04.485 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2024-04-19T00:22:04.503 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2024-04-19T00:22:04.503 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2024-04-19T00:22:04.503 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-04-19T00:22:04.519 INFO:teuthology.lock.ops:Start node 'smithi100.front.sepia.ceph.com' reimaging
2024-04-19T00:22:04.519 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: reset os type and version on server
2024-04-19T00:22:04.519 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server
2024-04-19T00:22:04.535 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging
2024-04-19T00:22:04.536 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server
2024-04-19T00:22:04.536 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server
2024-04-19T00:22:04.618 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-19T00:22:04.648 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-19T00:22:04.658 DEBUG:teuthology.provision.fog.smithi100:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-19T00:22:04.678 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-04-19T00:22:04.692 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of ubuntu 22.04
2024-04-19T00:22:04.707 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of ubuntu 22.04
2024-04-19T00:22:04.732 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 22.04
2024-04-19T00:22:04.735 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of ubuntu 22.04
2024-04-19T00:22:04.918 DEBUG:teuthology.provision.fog.smithi100:Canceling deploy task with ID 973234
2024-04-19T00:22:05.192 INFO:teuthology.orchestra.console.smithi029:Power off
2024-04-19T00:22:05.192 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:22:05.214 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2024-04-19T00:22:05.214 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.235 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-19T00:22:05.271 INFO:teuthology.orchestra.console.smithi100:Power off
2024-04-19T00:22:05.271 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:22:05.285 INFO:teuthology.orchestra.console.smithi102:Power off
2024-04-19T00:22:05.286 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:22:05.294 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-04-19T00:22:05.295 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.309 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-04-19T00:22:05.310 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.317 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-19T00:22:05.333 INFO:teuthology.orchestra.console.smithi072:Power off
2024-04-19T00:22:05.333 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:22:05.340 INFO:teuthology.orchestra.console.smithi029:Power off completed
2024-04-19T00:22:05.341 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-19T00:22:05.354 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-04-19T00:22:05.354 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.378 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-04-19T00:22:05.418 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-04-19T00:22:05.441 INFO:teuthology.orchestra.console.smithi029:Power on
2024-04-19T00:22:05.441 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-19T00:22:05.449 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-04-19T00:22:05.462 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On
2024-04-19T00:22:05.463 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.479 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-04-19T00:22:05.483 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-19T00:22:05.519 INFO:teuthology.orchestra.console.smithi100:Power on
2024-04-19T00:22:05.519 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-19T00:22:05.543 DEBUG:teuthology.orchestra.console.smithi100:power on output: Chassis Power Control: Up/On
2024-04-19T00:22:05.543 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.550 INFO:teuthology.orchestra.console.smithi102:Power on
2024-04-19T00:22:05.550 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-19T00:22:05.567 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-19T00:22:05.574 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On
2024-04-19T00:22:05.574 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.581 INFO:teuthology.orchestra.console.smithi072:Power on
2024-04-19T00:22:05.582 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-19T00:22:05.595 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-19T00:22:05.601 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On
2024-04-19T00:22:05.601 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:05.622 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-04-19T00:22:09.487 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:09.568 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:09.596 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:09.603 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-19T00:22:09.624 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:09.675 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-19T00:22:09.705 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-19T00:22:09.732 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-04-19T00:22:09.832 INFO:teuthology.orchestra.console.smithi072:Power on completed
2024-04-19T00:22:09.933 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2024-04-19T00:22:13.606 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:13.677 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:13.706 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:22:13.716 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2024-04-19T00:22:13.789 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-19T00:22:13.815 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-19T00:22:13.817 INFO:teuthology.orchestra.console.smithi029:Power on completed
2024-04-19T00:22:13.889 INFO:teuthology.orchestra.console.smithi100:Power on completed
2024-04-19T00:22:13.916 INFO:teuthology.orchestra.console.smithi102:Power on completed
2024-04-19T00:22:13.918 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2024-04-19T00:22:13.990 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish
2024-04-19T00:22:14.016 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish
2024-04-19T00:26:01.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:26:32.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:26:35.074 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-19T00:26:41.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:26:44.158 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-19T00:26:50.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:26:53.214 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-19T00:26:59.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:01.790 WARNING:teuthology.provision.fog.smithi100:timed out
2024-04-19T00:27:02.270 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-19T00:27:07.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:08.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:11.330 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-19T00:27:17.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:20.386 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29
2024-04-19T00:27:26.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:47.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:50.558 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-19T00:27:56.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:27:59.618 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-19T00:28:05.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:07.800 WARNING:teuthology.provision.fog.smithi100:timed out
2024-04-19T00:28:08.702 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-19T00:28:13.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:13.886 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-19T00:28:13.887 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-19T00:28:13.998 INFO:teuthology.provision.fog.smithi100:Node is ready
2024-04-19T00:28:13.999 DEBUG:teuthology.orchestra.run.smithi100:> hostname
2024-04-19T00:28:14.045 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100
2024-04-19T00:28:14.045 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100 /etc/hosts
2024-04-19T00:28:14.093 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100 smithi100
2024-04-19T00:28:14.094 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-04-19T00:28:14.149 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100/smithi100/g' /etc/hosts
2024-04-19T00:28:14.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts
2024-04-19T00:28:14.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100/smithi100/g' /etc/hostname
2024-04-19T00:28:14.313 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100
2024-04-19T00:28:14.368 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu"
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="22.04"
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=jammy
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu
2024-04-19T00:28:14.413 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian
2024-04-19T00:28:14.414 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-19T00:28:14.414 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-19T00:28:14.414 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-19T00:28:14.414 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-19T00:28:14.414 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=jammy
2024-04-19T00:28:14.414 INFO:teuthology.provision.fog.smithi100:Deploy complete!
2024-04-19T00:28:14.416 DEBUG:teuthology.parallel:result is None
2024-04-19T00:28:14.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:17.758 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-19T00:28:23.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:26.396 WARNING:teuthology.provision.fog.smithi029:timed out
2024-04-19T00:28:26.846 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-19T00:28:32.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:32.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:35.902 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102
2024-04-19T00:28:41.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:28:48.066 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-19T00:28:48.066 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-19T00:28:48.601 INFO:teuthology.provision.fog.smithi029:Node is ready
2024-04-19T00:28:48.602 DEBUG:teuthology.orchestra.run.smithi029:> hostname
2024-04-19T00:28:48.648 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2024-04-19T00:28:48.648 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts
2024-04-19T00:28:48.696 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2024-04-19T00:28:48.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-04-19T00:28:48.898 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts
2024-04-19T00:28:48.913 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts
2024-04-19T00:28:48.969 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname
2024-04-19T00:28:49.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029
2024-04-19T00:28:49.080 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release
2024-04-19T00:28:49.127 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="22.04"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=jammy
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-19T00:28:49.128 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=jammy
2024-04-19T00:28:49.128 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2024-04-19T00:28:49.129 DEBUG:teuthology.parallel:result is None
2024-04-19T00:29:13.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:29:14.167 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-19T00:29:41.909 WARNING:teuthology.provision.fog.smithi102:timed out
2024-04-19T00:29:47.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:29:48.162 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-19T00:29:48.163 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-19T00:29:48.596 INFO:teuthology.provision.fog.smithi102:Node is ready
2024-04-19T00:29:48.597 DEBUG:teuthology.orchestra.run.smithi102:> hostname
2024-04-19T00:29:48.645 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com
2024-04-19T00:29:48.646 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts
2024-04-19T00:29:48.696 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102
2024-04-19T00:29:48.696 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-04-19T00:29:48.810 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts
2024-04-19T00:29:48.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts
2024-04-19T00:29:48.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname
2024-04-19T00:29:48.939 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102
2024-04-19T00:29:48.993 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu"
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04"
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian
2024-04-19T00:29:49.046 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-19T00:29:49.047 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-19T00:29:49.047 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-19T00:29:49.047 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-19T00:29:49.047 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy
2024-04-19T00:29:49.047 INFO:teuthology.provision.fog.smithi102:Deploy complete!
2024-04-19T00:29:49.048 DEBUG:teuthology.parallel:result is None
2024-04-19T00:30:18.169 WARNING:teuthology.provision.fog.smithi072:timed out
2024-04-19T00:30:24.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:30:42.722 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-19T00:30:48.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:30:51.778 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-19T00:30:57.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:30:57.782 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-19T00:31:03.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:31:03.785 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-19T00:31:09.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:31:09.788 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-19T00:31:15.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:31:15.792 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2024-04-19T00:31:21.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-19T00:31:22.006 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-19T00:31:22.007 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-19T00:31:22.517 INFO:teuthology.provision.fog.smithi072:Node is ready
2024-04-19T00:31:22.517 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2024-04-19T00:31:22.565 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2024-04-19T00:31:22.565 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts
2024-04-19T00:31:22.618 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2024-04-19T00:31:22.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-04-19T00:31:22.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts
2024-04-19T00:31:22.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts
2024-04-19T00:31:22.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname
2024-04-19T00:31:22.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-04-19T00:31:22.980 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-19T00:31:23.026 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-19T00:31:23.027 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy
2024-04-19T00:31:23.027 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2024-04-19T00:31:23.028 DEBUG:teuthology.parallel:result is None
2024-04-19T00:31:24.222 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2024-04-19T00:31:24.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-19T00:31:24.506 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5225fcbd73b54ea88428b8768360a175
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2024-04-19T00:31:24.508 INFO:teuthology.nuke:Checking targets against current locks
2024-04-19T00:31:24.574 DEBUG:teuthology.nuke:shortname: smithi029
2024-04-19T00:31:24.574 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-19T00:31:24.600 DEBUG:teuthology.nuke:shortname: smithi072
2024-04-19T00:31:24.600 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-19T00:31:24.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 00:22:03.197541', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFBebiPLEL+ih/7n1aYBCVnNBsOpPNmYIGXhoK3fnCNXNO9PVra+B66ziiLy879jhMegGZPNTNA+4dK0LCKsQ5I='}
2024-04-19T00:31:24.631 DEBUG:teuthology.nuke:shortname: smithi100
2024-04-19T00:31:24.632 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-19T00:31:24.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 00:22:03.194846', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0xZhKSAqBXa5C8Qe/DtY5BbF75w8VQ1l/IyTC99SCwK/q1fTyScbYX1uAI7I8XZ1HMOS26en8PYHBZ0vsWkRc='}
2024-04-19T00:31:24.668 INFO:teuthology.orchestra.console.smithi029:Power off
2024-04-19T00:31:24.668 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:31:24.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 00:22:03.192083', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5L6emlBRXfwY4s0kb+Fx2/2jXwt72f9MV39wdkEUPUu+JFdpDYPrLnhOIc2FmkwRcmVYXFxZqaTYD/cHuUOzM='}
2024-04-19T00:31:24.684 DEBUG:teuthology.nuke:shortname: smithi102
2024-04-19T00:31:24.685 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-19T00:31:24.694 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off
2024-04-19T00:31:24.694 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:24.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663194', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 00:22:03.199866', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBsz/kulLCgigCwCSzgUx6zEaThDVc1ygSWNO6AH6l4SEAGLK5IipdZp33q0ma21ZkOOBCi98lKXvzTh9PM5wZ0='}
2024-04-19T00:31:24.725 INFO:teuthology.orchestra.console.smithi072:Power off
2024-04-19T00:31:24.725 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:31:24.737 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2024-04-19T00:31:24.749 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-04-19T00:31:24.749 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:24.767 INFO:teuthology.orchestra.console.smithi100:Power off
2024-04-19T00:31:24.767 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:31:24.780 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-04-19T00:31:24.792 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off
2024-04-19T00:31:24.792 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:24.808 INFO:teuthology.orchestra.console.smithi102:Power off
2024-04-19T00:31:24.808 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-19T00:31:24.818 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on
2024-04-19T00:31:24.832 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off
2024-04-19T00:31:24.833 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:24.856 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-19T00:31:28.737 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:28.781 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:28.818 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:28.848 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on
2024-04-19T00:31:28.856 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:28.891 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-04-19T00:31:28.929 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off
2024-04-19T00:31:28.966 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-19T00:31:29.030 INFO:teuthology.orchestra.console.smithi100:Power off completed
2024-04-19T00:31:29.181 INFO:teuthology.lock.ops:unlocked: smithi100.front.sepia.ceph.com
2024-04-19T00:31:32.849 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:32.893 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:32.960 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off
2024-04-19T00:31:32.967 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:33.003 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-04-19T00:31:33.061 INFO:teuthology.orchestra.console.smithi029:Power off completed
2024-04-19T00:31:33.077 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on
2024-04-19T00:31:33.104 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-04-19T00:31:33.214 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2024-04-19T00:31:33.256 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2024-04-19T00:31:37.079 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-19T00:31:37.189 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off
2024-04-19T00:31:37.290 INFO:teuthology.orchestra.console.smithi102:Power off completed
2024-04-19T00:31:37.447 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com
2024-04-19T00:31:37.959 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range