2023-12-11T12:35:15.916 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-11T12:35:15.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-11T12:35:16.049 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f614b581340>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f614c4da940>, signals=[15])
2023-12-11T12:35:16.049 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2023-12-11T12:35:16.050 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2023-12-11T12:35:16.050 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2023-12-11T12:35:16.072 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-12-11T12:35:16.072 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-12-11T12:35:16.072 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-12-11T12:35:16.190 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-11T12:35:16.225 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-11T12:35:16.228 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.6
2023-12-11T12:35:16.277 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of rhel 8.6
2023-12-11T12:35:16.452 INFO:teuthology.orchestra.console.smithi163:Power off
2023-12-11T12:35:16.453 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-11T12:35:16.474 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2023-12-11T12:35:16.474 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:16.494 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2023-12-11T12:35:16.512 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-11T12:35:16.512 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-11T12:35:16.532 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-11T12:35:16.532 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:16.557 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-11T12:35:16.595 INFO:teuthology.orchestra.console.smithi163:Power off completed
2023-12-11T12:35:16.695 INFO:teuthology.orchestra.console.smithi163:Power on
2023-12-11T12:35:16.696 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-11T12:35:16.716 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2023-12-11T12:35:16.716 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:16.736 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2023-12-11T12:35:20.561 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:20.670 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-11T12:35:20.738 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:20.846 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2023-12-11T12:35:24.674 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:24.784 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-11T12:35:24.847 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:24.885 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-11T12:35:24.957 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2023-12-11T12:35:24.986 INFO:teuthology.orchestra.console.smithi196:Power on
2023-12-11T12:35:24.986 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-11T12:35:25.008 DEBUG:teuthology.orchestra.console.smithi196:power on output: Chassis Power Control: Up/On
2023-12-11T12:35:25.009 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:25.029 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-11T12:35:25.057 INFO:teuthology.orchestra.console.smithi163:Power on completed
2023-12-11T12:35:25.158 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2023-12-11T12:35:29.030 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:29.139 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-11T12:35:33.142 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:35:33.251 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-11T12:35:33.351 INFO:teuthology.orchestra.console.smithi196:Power on completed
2023-12-11T12:35:33.452 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-12-11T12:36:10.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:36:13.506 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:36:19.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:36:22.566 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:36:28.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:36:31.654 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:36:37.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:36:40.738 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:36:46.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:36:49.798 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:36:55.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:36:58.882 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:37:04.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:37:07.942 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:37:13.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:37:17.026 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:37:23.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:37:26.082 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:37:32.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:37:35.170 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:37:41.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:37:51.330 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:37:57.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:38:00.386 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:38:04.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:38:06.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:38:06.514 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-11T12:38:10.639 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-11T12:38:17.727 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-11T12:38:27.814 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-11T12:38:40.902 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-11T12:38:57.026 ERROR:teuthology.orchestra.connection:Error authenticating with smithi163.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-11T12:39:34.485 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-12-11T12:39:45.854 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614b02b340>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:39:52.873 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614b02b100>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:39:54.726 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-12-11T12:40:02.889 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614afca0d0>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:40:15.909 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614afcaac0>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:40:16.030 WARNING:teuthology.provision.fog.smithi163:timed out
2023-12-11T12:40:22.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:40:25.094 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2023-12-11T12:40:31.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:40:31.927 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614b16aee0>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:40:50.943 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614afd3ee0>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:41:12.961 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614afdb970>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:41:31.097 WARNING:teuthology.provision.fog.smithi163:timed out
2023-12-11T12:41:37.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-11T12:41:37.558 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-11T12:41:37.559 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-11T12:41:37.827 INFO:teuthology.provision.fog.smithi163:Node is ready
2023-12-11T12:41:37.827 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2023-12-11T12:41:37.847 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2023-12-11T12:41:37.847 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2023-12-11T12:41:37.907 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2023-12-11T12:41:37.907 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2023-12-11T12:41:37.978 ERROR:teuthology.orchestra.connection:Error authenticating with smithi196.front.sepia.ceph.com: BadHostKeyException('smithi196.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f614b16a220>, <paramiko.ed25519key.Ed25519Key object at 0x7f614b16a970>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi196.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAINWhz3xFAZXuh+a51r1pmvKp8VVG8CNhEn+82dbjERkf'
2023-12-11T12:41:38.022 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2023-12-11T12:41:38.052 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2023-12-11T12:41:38.122 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2023-12-11T12:41:38.204 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2023-12-11T12:41:38.273 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2023-12-11T12:41:38.332 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-11T12:41:38.333 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2023-12-11T12:41:38.334 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-11T12:41:38.334 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-11T12:41:38.334 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-11T12:41:38.336 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi163's OS to be rhel 8.6 but found centos 8
2023-12-11T12:41:38.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-11T12:41:38.479 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=07746b9f8b184946b92b0cdd2e6e0e4d
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi163's OS to be rhel 8.6 but found centos 8
2023-12-11T12:41:38.481 INFO:teuthology.nuke:Checking targets against current locks
2023-12-11T12:41:38.542 DEBUG:teuthology.nuke:shortname: smithi163
2023-12-11T12:41:38.542 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-11T12:41:38.562 DEBUG:teuthology.nuke:shortname: smithi196
2023-12-11T12:41:38.562 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-11T12:41:38.565 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-11_11:57:03-orch:cephadm-wip-guits-testing-2023-12-11-0906-distro-default-smithi/7486852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 12:35:55.958780', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKTkIbw+VY9ufsncN+BfS/10Gc+HM4aFrQ9WN99Kz8bQ6kU/0kuD6ehJRBQvKPXJ1tJ7B0KbimfyScutMmpOxU='}
2023-12-11T12:41:38.589 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-12-11_11:57:03-orch:cephadm-wip-guits-testing-2023-12-11-0906-distro-default-smithi/7486850', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 12:35:15.122343', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-12-11T12:41:38.613 INFO:teuthology.orchestra.console.smithi163:Power off
2023-12-11T12:41:38.613 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-11T12:41:38.638 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2023-12-11T12:41:38.638 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:38.654 INFO:teuthology.orchestra.console.smithi196:Power off
2023-12-11T12:41:38.655 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-11T12:41:38.665 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2023-12-11T12:41:38.678 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off
2023-12-11T12:41:38.678 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:38.702 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-11T12:41:42.666 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:42.704 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:42.776 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2023-12-11T12:41:42.814 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-11T12:41:46.777 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:46.815 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:46.887 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2023-12-11T12:41:46.925 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on
2023-12-11T12:41:50.888 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:50.926 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-11T12:41:50.999 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2023-12-11T12:41:51.035 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off
2023-12-11T12:41:51.100 INFO:teuthology.orchestra.console.smithi163:Power off completed
2023-12-11T12:41:51.136 INFO:teuthology.orchestra.console.smithi196:Power off completed
2023-12-11T12:41:51.258 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com
2023-12-11T12:41:51.281 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2023-12-11T12:41:51.522 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi163's OS to be rhel 8.6 but found centos 8