2024-03-25T01:58:17.117 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-25T01:58:17.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:58:17.261 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f77062b9c10>, signals=[15]) 2024-03-25T01:58:17.262 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-03-25T01:58:17.262 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T01:58:17.262 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-03-25T01:58:17.284 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging 2024-03-25T01:58:17.284 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T01:58:17.284 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-03-25T01:58:17.399 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-25T01:58:17.420 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-25T01:58:17.444 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 22.04 2024-03-25T01:58:17.463 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of ubuntu 22.04 2024-03-25T01:58:17.527 DEBUG:teuthology.provision.fog.smithi148:Canceling deploy task with ID 891946 2024-03-25T01:58:17.751 INFO:teuthology.orchestra.console.smithi171:Power off 2024-03-25T01:58:17.751 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T01:58:17.764 INFO:teuthology.orchestra.console.smithi148:Power off 2024-03-25T01:58:17.764 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T01:58:17.771 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-03-25T01:58:17.772 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:17.785 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-03-25T01:58:17.785 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:17.793 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-25T01:58:17.808 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-25T01:58:17.894 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-03-25T01:58:17.909 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-03-25T01:58:17.995 INFO:teuthology.orchestra.console.smithi171:Power on 2024-03-25T01:58:17.996 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T01:58:18.010 INFO:teuthology.orchestra.console.smithi148:Power on 2024-03-25T01:58:18.011 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T01:58:18.023 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On 2024-03-25T01:58:18.023 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:18.032 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-03-25T01:58:18.032 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:18.053 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-25T01:58:18.063 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-25T01:58:22.058 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:22.064 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:22.166 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-03-25T01:58:22.172 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-25T01:58:26.170 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:26.177 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:58:26.280 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-03-25T01:58:26.286 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-25T01:58:26.381 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-03-25T01:58:26.387 INFO:teuthology.orchestra.console.smithi171:Power on completed 2024-03-25T01:58:26.482 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-03-25T01:58:26.488 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2024-03-25T02:01:42.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:01:42.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:01:45.890 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:01:51.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:01:54.974 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:02:00.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:04.030 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:02:10.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:13.086 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:02:19.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:22.142 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:02:28.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:31.198 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:02:37.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:40.254 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:02:42.814 WARNING:teuthology.provision.fog.smithi148:timed out 2024-03-25T02:02:46.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:48.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:02:51.874 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:02:57.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:00.930 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:03:04.610 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:06.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:09.986 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:03:10.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:13.666 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:15.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:17.022 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:03:19.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:20.702 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:23.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:23.027 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:03:26.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:26.708 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:29.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:29.032 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:03:32.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:32.712 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:35.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:35.036 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-03-25T02:03:38.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:38.719 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:41.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:41.235 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T02:03:41.235 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T02:03:41.963 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-03-25T02:03:41.963 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-03-25T02:03:42.008 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2024-03-25T02:03:42.009 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2024-03-25T02:03:42.056 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2024-03-25T02:03:42.057 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-03-25T02:03:42.258 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2024-03-25T02:03:42.271 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2024-03-25T02:03:42.328 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2024-03-25T02:03:42.383 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-03-25T02:03:42.433 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2024-03-25T02:03:42.480 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2024-03-25T02:03:42.481 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-25T02:03:42.481 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-25T02:03:42.481 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-25T02:03:42.481 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-25T02:03:42.481 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2024-03-25T02:03:42.482 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-03-25T02:03:42.483 DEBUG:teuthology.parallel:result is None 2024-03-25T02:03:44.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:44.725 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-03-25T02:03:50.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T02:03:50.991 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T02:03:50.991 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T02:03:51.613 INFO:teuthology.provision.fog.smithi171:Node is ready 2024-03-25T02:03:51.613 DEBUG:teuthology.orchestra.run.smithi171:> hostname 2024-03-25T02:03:51.661 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com 2024-03-25T02:03:51.661 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts 2024-03-25T02:03:51.709 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2024-03-25T02:03:51.709 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2024-03-25T02:03:51.858 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts 2024-03-25T02:03:51.873 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts 2024-03-25T02:03:51.929 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname 2024-03-25T02:03:51.986 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2024-03-25T02:03:52.044 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="22.04" 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=jammy 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-25T02:03:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-25T02:03:52.094 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-25T02:03:52.094 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-25T02:03:52.094 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=jammy 2024-03-25T02:03:52.094 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2024-03-25T02:03:52.095 DEBUG:teuthology.parallel:result is None 2024-03-25T02:03:53.180 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range 2024-03-25T02:03:53.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:03:53.464 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bf4116c748b64ac8a3718a940e33809f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range 2024-03-25T02:03:53.466 INFO:teuthology.nuke:Checking targets against current locks 2024-03-25T02:03:53.500 INFO:teuthology.nuke:Not nuking smithi148.front.sepia.ceph.com because description doesn't match: yuriw-2024-03-25_00:22:23-rados-wip-yuri3-testing-2024-03-24-1519-distro-default-smithi != None 2024-03-25T02:03:53.537 DEBUG:teuthology.nuke:shortname: smithi171 2024-03-25T02:03:53.538 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-25T02:03:53.558 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-25_00:22:23-rados-wip-yuri3-testing-2024-03-24-1519-distro-default-smithi/7620837', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-25 01:58:16.023937', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdlEBau/Id3V3AF4qpwd+uaHjp0yDe2nFBz18lxQudV03pFGE9Ul7kFy/oTMd41ZD2fOy0+JPfGNoyLC++WwOI='} 2024-03-25T02:03:53.603 INFO:teuthology.orchestra.console.smithi171:Power off 2024-03-25T02:03:53.603 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T02:03:53.629 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-03-25T02:03:53.630 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T02:03:53.654 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-25T02:03:57.659 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T02:03:57.769 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-03-25T02:04:01.771 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T02:04:01.881 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-03-25T02:04:01.982 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-03-25T02:04:02.129 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com 2024-03-25T02:04:02.131 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJd7poV/5rC6ZmFnB6eTcJwx0NgV9ZlO3iFcO9ZzqiiZFLYXKSFOOl/SVxocbMf1JfTcyBKLueW2QEuac5jQAYM= 2024-03-25T02:04:02.390 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range