2023-12-12T03:31:27.091 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-12T03:31:27.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T03:31:27.224 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbff38f7520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbff4851940>, signals=[15])
2023-12-12T03:31:27.224 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-12-12T03:31:27.224 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T03:31:27.225 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-12-12T03:31:27.241 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-12-12T03:31:27.241 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-12-12T03:31:27.242 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-12-12T03:31:27.357 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-12T03:31:27.382 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-12T03:31:27.397 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of ubuntu 22.04
2023-12-12T03:31:27.430 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 22.04
2023-12-12T03:31:27.467 DEBUG:teuthology.provision.fog.smithi043:Canceling deploy task with ID 661954
2023-12-12T03:31:27.715 INFO:teuthology.orchestra.console.smithi136:Power off
2023-12-12T03:31:27.715 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T03:31:27.737 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-12-12T03:31:27.738 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:27.761 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-12-12T03:31:27.786 INFO:teuthology.orchestra.console.smithi043:Power off
2023-12-12T03:31:27.787 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T03:31:27.810 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-12-12T03:31:27.811 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:27.832 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-12-12T03:31:31.763 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:31.834 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:31.872 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-12-12T03:31:31.942 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-12-12T03:31:35.874 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:35.943 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:35.983 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-12-12T03:31:36.052 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-12T03:31:36.084 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-12-12T03:31:36.153 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-12-12T03:31:36.185 INFO:teuthology.orchestra.console.smithi136:Power on
2023-12-12T03:31:36.185 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T03:31:36.206 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2023-12-12T03:31:36.207 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:36.229 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-12-12T03:31:36.254 INFO:teuthology.orchestra.console.smithi043:Power on
2023-12-12T03:31:36.254 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-12T03:31:36.273 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On
2023-12-12T03:31:36.274 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:36.293 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-12T03:31:40.230 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:40.294 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:40.339 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-12-12T03:31:40.402 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-12T03:31:44.346 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:44.403 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:31:44.454 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-12-12T03:31:44.514 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on
2023-12-12T03:31:44.556 INFO:teuthology.orchestra.console.smithi136:Power on completed
2023-12-12T03:31:44.614 INFO:teuthology.orchestra.console.smithi043:Power on completed
2023-12-12T03:31:44.657 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-12-12T03:31:44.715 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-12-12T03:34:45.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:00.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:04.290 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:35:10.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:10.530 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:35:16.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:19.138 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-12-12T03:35:19.590 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:35:25.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:25.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:28.226 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-12-12T03:35:28.678 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:35:34.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:34.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:37.282 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-12-12T03:35:37.730 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:35:43.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:43.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:35:46.338 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-12-12T03:35:52.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:36:15.203 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:36:21.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:36:21.211 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:36:27.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:36:27.218 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:36:33.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:36:37.532 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-12-12T03:36:43.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:36:43.752 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T03:36:43.753 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T03:36:44.270 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-12-12T03:36:44.270 DEBUG:teuthology.orchestra.run.smithi043:> hostname
2023-12-12T03:36:44.321 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-12-12T03:36:44.321 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts
2023-12-12T03:36:44.370 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-12-12T03:36:44.371 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-12-12T03:36:44.512 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts
2023-12-12T03:36:44.527 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts
2023-12-12T03:36:44.583 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname
2023-12-12T03:36:44.637 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043
2023-12-12T03:36:44.691 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release
2023-12-12T03:36:44.737 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-12T03:36:44.737 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu"
2023-12-12T03:36:44.737 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="22.04"
2023-12-12T03:36:44.737 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-12T03:36:44.737 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=jammy
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-12T03:36:44.738 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=jammy
2023-12-12T03:36:44.739 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-12-12T03:36:44.740 DEBUG:teuthology.parallel:result is None
2023-12-12T03:36:52.352 WARNING:teuthology.provision.fog.smithi136:timed out
2023-12-12T03:36:58.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-12T03:36:58.555 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-12T03:36:58.555 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-12T03:36:59.159 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-12-12T03:36:59.159 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2023-12-12T03:36:59.211 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2023-12-12T03:36:59.211 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2023-12-12T03:36:59.259 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2023-12-12T03:36:59.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-12-12T03:36:59.400 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2023-12-12T03:36:59.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2023-12-12T03:36:59.470 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2023-12-12T03:36:59.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-12-12T03:36:59.585 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-12-12T03:36:59.630 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-12T03:36:59.630 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu"
2023-12-12T03:36:59.630 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="22.04"
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=jammy
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-12T03:36:59.631 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=jammy
2023-12-12T03:36:59.631 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-12-12T03:36:59.632 DEBUG:teuthology.parallel:result is None
2023-12-12T03:37:00.729 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-12-12T03:37:00.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-12T03:37:00.881 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9f6398bf1cdc47588ba481195b050b49
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-12-12T03:37:00.883 INFO:teuthology.nuke:Checking targets against current locks
2023-12-12T03:37:00.943 DEBUG:teuthology.nuke:shortname: smithi043
2023-12-12T03:37:00.944 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T03:37:00.963 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-12_01:08:53-rbd-wip-dis-testing-2-distro-default-smithi/7488010', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 03:36:58.549283', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJCy2m7qT3ukHpMbWHcmSjOo6djL5Zbx+1TR7gB7B0VSrKCTYyIuvWcNI7t0HOwahDAAaDREuPG5vPv12/wGDzo='}
2023-12-12T03:37:00.971 DEBUG:teuthology.nuke:shortname: smithi136
2023-12-12T03:37:00.971 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-12T03:37:00.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-12-12_01:08:53-rbd-wip-dis-testing-2-distro-default-smithi/7488006', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 03:31:26.235124', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHSuLH2yj5ZAs/S9MtUT3BWgrj2B31454KkkS+Wuk1xkZaW2eMZZTkLYqL+rWn9zHz0wsWrxXKLdZeXmcFrG81o='}
2023-12-12T03:37:01.004 INFO:teuthology.orchestra.console.smithi043:Power off
2023-12-12T03:37:01.005 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T03:37:01.025 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off
2023-12-12T03:37:01.026 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:37:01.044 INFO:teuthology.orchestra.console.smithi136:Power off
2023-12-12T03:37:01.044 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-12T03:37:01.052 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off
2023-12-12T03:37:01.066 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-12-12T03:37:01.066 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:37:01.087 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-12-12T03:37:01.154 INFO:teuthology.orchestra.console.smithi043:Power off completed
2023-12-12T03:37:01.299 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2023-12-12T03:37:05.090 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:37:05.199 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-12-12T03:37:09.202 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:37:09.311 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-12-12T03:37:13.314 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-12T03:37:13.423 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-12-12T03:37:13.524 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-12-12T03:37:13.682 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2023-12-12T03:37:13.905 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range