2023-10-14T12:15:22.553 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T12:15:22.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:15:22.708 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f83a469aca0>, signals=[15]) 2023-10-14T12:15:22.709 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-10-14T12:15:22.709 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T12:15:22.709 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-10-14T12:15:22.781 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-10-14T12:15:22.781 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-10-14T12:15:22.782 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-10-14T12:15:22.783 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /host {"name": "smithi045"} 2023-10-14T12:15:22.856 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-14T12:15:22.899 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-14T12:15:22.899 DEBUG:teuthology.provision.fog.smithi045:FOG request: PUT /host/150 {"imageID": 6} 2023-10-14T12:15:22.944 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of ubuntu 22.04 2023-10-14T12:15:22.945 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:15:22.994 DEBUG:teuthology.provision.fog.smithi045:Canceling deploy task with ID 545344 2023-10-14T12:15:22.994 DEBUG:teuthology.provision.fog.smithi045:FOG request: DELETE /task/cancel {"id": 545344} 2023-10-14T12:15:23.021 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-10-14T12:15:23.078 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T12:15:23.115 DEBUG:teuthology.provision.fog.smithi045:FOG request: POST /host/150/task {"taskTypeID": 1} 2023-10-14T12:15:23.129 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-10-14T12:15:23.169 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-10-14T12:15:23.169 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 6} 2023-10-14T12:15:23.175 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:15:23.215 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of ubuntu 22.04 2023-10-14T12:15:23.215 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:15:23.253 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-14T12:15:23.254 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:15:23.262 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-10-14T12:15:23.273 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-14T12:15:23.274 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:23.294 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-14T12:15:23.304 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-10-14T12:15:23.381 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:15:23.396 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-14T12:15:23.458 INFO:teuthology.orchestra.console.smithi152:Power off 2023-10-14T12:15:23.459 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:15:23.479 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-10-14T12:15:23.480 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:23.497 INFO:teuthology.orchestra.console.smithi045:Power on 2023-10-14T12:15:23.498 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T12:15:23.510 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-14T12:15:23.521 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2023-10-14T12:15:23.521 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:23.544 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-14T12:15:23.611 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-10-14T12:15:23.712 INFO:teuthology.orchestra.console.smithi152:Power on 2023-10-14T12:15:23.713 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-14T12:15:23.734 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-10-14T12:15:23.734 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:23.759 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-14T12:15:27.546 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:27.657 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-14T12:15:27.758 INFO:teuthology.orchestra.console.smithi045:Power on completed 2023-10-14T12:15:27.760 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:27.859 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-10-14T12:15:27.860 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:15:27.873 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-14T12:15:31.876 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:15:31.986 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-14T12:15:32.087 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-10-14T12:15:32.188 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-10-14T12:15:32.189 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:15:42.934 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:15:47.250 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:15:57.998 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:16:02.310 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:16:13.064 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:16:17.370 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:16:28.134 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:16:32.440 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:16:43.214 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:16:47.506 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:16:58.288 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:17:02.570 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:17:13.358 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:17:17.638 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:17:28.430 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:17:32.703 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:17:43.507 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:17:47.774 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:17:58.574 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:18:02.846 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:18:13.651 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:18:17.918 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:18:28.730 DEBUG:teuthology.provision.fog.smithi045:FOG request: GET /task/active None 2023-10-14T12:18:28.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:18:32.992 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:18:47.038 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-14T12:18:48.066 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-10-14T12:18:48.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:18:53.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:18:56.090 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-14T12:19:02.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:05.147 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-14T12:19:06.490 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-14T12:19:11.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:12.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:14.207 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-10-14T12:19:15.550 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-14T12:19:20.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:21.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:24.634 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-14T12:19:30.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:33.690 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-14T12:19:39.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:42.746 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-14T12:19:48.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:19:51.802 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-10-14T12:19:57.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:20:20.234 WARNING:teuthology.provision.fog.smithi045:timed out 2023-10-14T12:20:26.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:20:26.476 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T12:20:26.477 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T12:20:27.374 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-10-14T12:20:27.375 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-10-14T12:20:27.422 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-10-14T12:20:27.422 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-10-14T12:20:27.473 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-10-14T12:20:27.473 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-10-14T12:20:27.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-10-14T12:20:27.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-10-14T12:20:27.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-10-14T12:20:27.736 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-10-14T12:20:27.793 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-10-14T12:20:27.839 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-14T12:20:27.839 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-10-14T12:20:27.840 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="22.04" 2023-10-14T12:20:27.840 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-14T12:20:27.840 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=jammy 2023-10-14T12:20:27.840 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-10-14T12:20:27.841 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-10-14T12:20:27.841 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-14T12:20:27.841 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-14T12:20:27.841 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-14T12:20:27.842 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-14T12:20:27.842 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=jammy 2023-10-14T12:20:27.843 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-10-14T12:20:27.844 DEBUG:teuthology.parallel:result is None 2023-10-14T12:20:57.838 WARNING:teuthology.provision.fog.smithi152:timed out 2023-10-14T12:21:03.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:21:04.063 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-14T12:21:04.063 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-14T12:21:04.512 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-10-14T12:21:04.513 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-10-14T12:21:04.559 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-10-14T12:21:04.560 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-10-14T12:21:04.607 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-10-14T12:21:04.608 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-10-14T12:21:04.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-10-14T12:21:04.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-10-14T12:21:04.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-10-14T12:21:04.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-10-14T12:21:04.922 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-10-14T12:21:04.971 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-10-14T12:21:04.971 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2023-10-14T12:21:04.972 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="22.04" 2023-10-14T12:21:04.972 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-10-14T12:21:04.972 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=jammy 2023-10-14T12:21:04.972 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2023-10-14T12:21:04.973 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2023-10-14T12:21:04.973 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-14T12:21:04.973 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-14T12:21:04.973 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-14T12:21:04.973 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-14T12:21:04.974 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=jammy 2023-10-14T12:21:04.974 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-10-14T12:21:04.975 DEBUG:teuthology.parallel:result is None 2023-10-14T12:21:06.059 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range 2023-10-14T12:21:06.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:21:06.210 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=776c1a4689284098aa6df9f4c6c11db2 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range 2023-10-14T12:21:06.212 INFO:teuthology.nuke:Checking targets against current locks 2023-10-14T12:21:06.278 DEBUG:teuthology.nuke:shortname: smithi045 2023-10-14T12:21:06.278 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:21:06.296 DEBUG:teuthology.nuke:shortname: smithi152 2023-10-14T12:21:06.297 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:21:06.301 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425328', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:20:45.344262', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMytUBIa8i5ARJB/EkGnP7iK75A/axPv3I4FcvTOdOwZgsLGB7BJgMZWcIWzSwpQ+mWHrRPB2R+J8mtuJduNKQk='} 2023-10-14T12:21:06.319 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425321', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:15:21.712139', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP1uvla57Q+htgg3eI3miB93Z/bGysp0/pyHy7ZSozI0TJpfpmBPvRNX1IdVQU4qzqrJt6e1XcrZuRHZV2MCkfY='} 2023-10-14T12:21:06.347 INFO:teuthology.orchestra.console.smithi045:Power off 2023-10-14T12:21:06.348 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:21:06.371 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-10-14T12:21:06.371 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:06.391 INFO:teuthology.orchestra.console.smithi152:Power off 2023-10-14T12:21:06.392 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-14T12:21:06.401 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-14T12:21:06.415 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-10-14T12:21:06.416 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:06.440 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-14T12:21:10.406 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:10.441 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:10.516 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-10-14T12:21:10.552 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-10-14T12:21:14.522 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:14.553 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-14T12:21:14.631 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-10-14T12:21:14.664 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-10-14T12:21:14.733 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-10-14T12:21:14.766 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-10-14T12:21:14.887 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2023-10-14T12:21:14.912 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2023-10-14T12:21:15.132 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 326, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/lock/ops.py", line 290, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1108, in ssh_keyscan key = _ssh_keyscan(hostname) File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/misc.py", line 1145, in _ssh_keyscan return sorted(keys)[0] IndexError: list index out of range