2023-10-10T21:32:58.193 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-10T21:32:58.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:32:58.339 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbdb2815b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbdb3300670>, signals=[15])
2023-10-10T21:32:58.340 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging
2023-10-10T21:32:58.341 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server
2023-10-10T21:32:58.341 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2023-10-10T21:32:58.358 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2023-10-10T21:32:58.358 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2023-10-10T21:32:58.358 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-10-10T21:32:58.360 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"}
2023-10-10T21:32:58.383 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"}
2023-10-10T21:32:58.434 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-10T21:32:58.450 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-10T21:32:58.475 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_8.stream (ID 3)
2023-10-10T21:32:58.475 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 3}
2023-10-10T21:32:58.494 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3)
2023-10-10T21:32:58.494 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 3}
2023-10-10T21:32:58.530 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream
2023-10-10T21:32:58.531 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:32:58.539 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream
2023-10-10T21:32:58.539 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:32:58.587 DEBUG:teuthology.provision.fog.smithi132:Canceling deploy task with ID 536613
2023-10-10T21:32:58.588 DEBUG:teuthology.provision.fog.smithi132:FOG request: DELETE /task/cancel {"id": 536613}
2023-10-10T21:32:58.592 DEBUG:teuthology.provision.fog.smithi064:Canceling deploy task with ID 536612
2023-10-10T21:32:58.592 DEBUG:teuthology.provision.fog.smithi064:FOG request: DELETE /task/cancel {"id": 536612}
2023-10-10T21:32:58.742 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"}
2023-10-10T21:32:58.745 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"}
2023-10-10T21:32:58.780 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1}
2023-10-10T21:32:58.785 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1}
2023-10-10T21:32:58.831 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:32:58.852 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:32:58.924 INFO:teuthology.orchestra.console.smithi132:Power off
2023-10-10T21:32:58.925 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T21:32:58.938 INFO:teuthology.orchestra.console.smithi064:Power off
2023-10-10T21:32:58.939 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T21:32:58.949 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-10-10T21:32:58.949 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:32:58.972 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-10-10T21:32:59.057 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2023-10-10T21:32:59.057 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:32:59.078 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-10-10T21:33:02.977 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:03.079 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:03.088 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-10-10T21:33:03.188 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-10-10T21:33:07.093 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:07.190 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:07.203 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-10-10T21:33:07.299 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-10-10T21:33:11.206 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:11.300 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:11.315 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-10-10T21:33:11.409 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-10-10T21:33:11.417 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-10-10T21:33:11.511 INFO:teuthology.orchestra.console.smithi064:Power off completed
2023-10-10T21:33:11.518 INFO:teuthology.orchestra.console.smithi132:Power on
2023-10-10T21:33:11.519 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-10T21:33:11.541 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2023-10-10T21:33:11.542 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:11.564 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-10-10T21:33:11.612 INFO:teuthology.orchestra.console.smithi064:Power on
2023-10-10T21:33:11.612 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-10T21:33:11.636 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On
2023-10-10T21:33:11.637 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:11.659 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-10-10T21:33:15.568 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:15.661 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:15.677 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-10-10T21:33:15.770 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-10-10T21:33:19.678 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:19.772 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:33:19.881 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-10-10T21:33:19.891 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-10-10T21:33:19.983 INFO:teuthology.orchestra.console.smithi064:Power on completed
2023-10-10T21:33:19.992 INFO:teuthology.orchestra.console.smithi132:Power on completed
2023-10-10T21:33:20.084 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2023-10-10T21:33:20.085 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:33:20.093 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2023-10-10T21:33:20.094 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:33:35.174 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:33:35.176 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:33:50.275 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:33:50.279 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:34:05.386 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:34:05.388 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:34:20.498 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:34:20.500 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:34:35.602 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:34:35.604 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:34:50.710 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:34:50.712 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:35:05.814 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:35:05.817 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:35:20.962 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:35:20.964 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:35:36.106 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:35:36.129 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:35:51.262 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None
2023-10-10T21:35:51.264 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None
2023-10-10T21:35:51.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:35:51.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:36:25.979 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-10-10T21:36:31.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:36:35.038 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-10-10T21:36:41.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:36:51.394 WARNING:teuthology.provision.fog.smithi064:timed out
2023-10-10T21:36:57.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:37:15.390 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-10-10T21:37:21.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:37:24.478 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64
2023-10-10T21:37:30.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:37:30.720 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-10T21:37:30.721 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-10T21:37:41.046 WARNING:teuthology.provision.fog.smithi132:timed out
2023-10-10T21:37:47.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-10T21:37:47.113 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-10T21:37:47.114 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-10T21:37:47.191 INFO:teuthology.provision.fog.smithi132:Node is ready
2023-10-10T21:37:47.192 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2023-10-10T21:37:47.251 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132
2023-10-10T21:37:47.252 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132 /etc/hosts
2023-10-10T21:37:47.312 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132 smithi132
2023-10-10T21:37:47.313 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-10-10T21:37:47.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hosts
2023-10-10T21:37:47.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2023-10-10T21:37:47.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132/smithi132/g' /etc/hostname
2023-10-10T21:37:47.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-10-10T21:37:47.663 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-10-10T21:37:47.721 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2023-10-10T21:37:47.722 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8"
2023-10-10T21:37:47.722 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2023-10-10T21:37:47.722 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2023-10-10T21:37:47.722 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8"
2023-10-10T21:37:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-10-10T21:37:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-10T21:37:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-10-10T21:37:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-10T21:37:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2023-10-10T21:37:47.723 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-10T21:37:47.724 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-10T21:37:47.724 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-10T21:37:47.725 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2023-10-10T21:37:47.726 DEBUG:teuthology.parallel:result is None
2023-10-10T21:37:51.053 INFO:teuthology.provision.fog.smithi064:Node is ready
2023-10-10T21:37:51.053 DEBUG:teuthology.orchestra.run.smithi064:> hostname
2023-10-10T21:37:51.076 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com
2023-10-10T21:37:51.077 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts
2023-10-10T21:37:51.138 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064
2023-10-10T21:37:51.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2023-10-10T21:37:51.212 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts
2023-10-10T21:37:51.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts
2023-10-10T21:37:51.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname
2023-10-10T21:37:51.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064
2023-10-10T21:37:51.503 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release
2023-10-10T21:37:51.563 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream"
2023-10-10T21:37:51.563 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8"
2023-10-10T21:37:51.563 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos"
2023-10-10T21:37:51.564 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora"
2023-10-10T21:37:51.564 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8"
2023-10-10T21:37:51.564 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8"
2023-10-10T21:37:51.564 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-10T21:37:51.564 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31"
2023-10-10T21:37:51.565 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-10T21:37:51.565 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/"
2023-10-10T21:37:51.565 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-10T21:37:51.565 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-10T21:37:51.565 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-10T21:37:51.566 INFO:teuthology.provision.fog.smithi064:Deploy complete!
2023-10-10T21:37:51.566 DEBUG:teuthology.parallel:result is None
2023-10-10T21:37:52.731 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-10-10T21:37:52.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-10T21:37:52.888 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=2536879e44b841ecbbdc2334c31bd765
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range
2023-10-10T21:37:52.890 INFO:teuthology.nuke:Checking targets against current locks
2023-10-10T21:37:52.953 DEBUG:teuthology.nuke:shortname: smithi064
2023-10-10T21:37:52.953 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-10T21:37:52.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-10-10_20:48:39-rgw-main-distro-default-smithi/7420574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 21:32:57.356891', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK0MEREX//+ft7QuXlFexzsDO+sZD941LN0gvb2SFTg/9OmlPAe4pBdC+U70SbNttsZFI24sKdQnyBXLv6QWTqM='}
2023-10-10T21:37:52.980 DEBUG:teuthology.nuke:shortname: smithi132
2023-10-10T21:37:52.980 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-10T21:37:53.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-10-10_20:48:39-rgw-main-distro-default-smithi/7420574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 21:32:57.358113', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKKIOCjyUMSwY0KlIQ1H7YtBWyhFlOBt+ky5h8UKmpb7vkFK/ZBkQc3wt5ikShEw2j4+AE5hLtEyZiEzw1kkJko='}
2023-10-10T21:37:53.033 INFO:teuthology.orchestra.console.smithi064:Power off
2023-10-10T21:37:53.034 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T21:37:53.071 INFO:teuthology.orchestra.console.smithi132:Power off
2023-10-10T21:37:53.072 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-10T21:37:53.081 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off
2023-10-10T21:37:53.081 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:37:53.094 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-10-10T21:37:53.094 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:37:53.106 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on
2023-10-10T21:37:53.122 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-10-10T21:37:57.110 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:37:57.123 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-10T21:37:57.220 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off
2023-10-10T21:37:57.231 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-10-10T21:37:57.321 INFO:teuthology.orchestra.console.smithi064:Power off completed
2023-10-10T21:37:57.333 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-10-10T21:37:57.480 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com
2023-10-10T21:37:57.496 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com
2023-10-10T21:37:57.709 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1108, in ssh_keyscan
    key = _ssh_keyscan(hostname)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/misc.py", line 1145, in _ssh_keyscan
    return sorted(keys)[0]
IndexError: list index out of range