2024-02-12T15:54:23.899 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22
2024-02-12T15:54:23.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T15:54:24.015 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7ab0d37f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7ab1d98c10>, signals=[15])
2024-02-12T15:54:24.015 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging
2024-02-12T15:54:24.016 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server
2024-02-12T15:54:24.016 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-02-12T15:54:24.034 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2024-02-12T15:54:24.034 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2024-02-12T15:54:24.034 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-02-12T15:54:24.145 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_8.stream (ID 3)
2024-02-12T15:54:24.168 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_8.stream (ID 3)
2024-02-12T15:54:24.195 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 8.stream
2024-02-12T15:54:24.205 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream
2024-02-12T15:54:24.425 INFO:teuthology.orchestra.console.smithi028:Power off
2024-02-12T15:54:24.425 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-12T15:54:24.439 INFO:teuthology.orchestra.console.smithi037:Power off
2024-02-12T15:54:24.440 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-12T15:54:24.449 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off
2024-02-12T15:54:24.449 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:24.461 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off
2024-02-12T15:54:24.462 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:24.471 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-02-12T15:54:24.484 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-02-12T15:54:24.571 INFO:teuthology.orchestra.console.smithi028:Power off completed
2024-02-12T15:54:24.585 INFO:teuthology.orchestra.console.smithi037:Power off completed
2024-02-12T15:54:24.672 INFO:teuthology.orchestra.console.smithi028:Power on
2024-02-12T15:54:24.673 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-12T15:54:24.686 INFO:teuthology.orchestra.console.smithi037:Power on
2024-02-12T15:54:24.686 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-12T15:54:24.694 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On
2024-02-12T15:54:24.694 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:24.710 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On
2024-02-12T15:54:24.710 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:24.718 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off
2024-02-12T15:54:24.731 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-02-12T15:54:28.723 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:28.731 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:28.832 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on
2024-02-12T15:54:28.840 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off
2024-02-12T15:54:28.933 INFO:teuthology.orchestra.console.smithi028:Power on completed
2024-02-12T15:54:29.034 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish
2024-02-12T15:54:32.845 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-12T15:54:32.954 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on
2024-02-12T15:54:33.054 INFO:teuthology.orchestra.console.smithi037:Power on completed
2024-02-12T15:54:33.155 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2024-02-12T15:56:48.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:56:59.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:57:02.972 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-12T15:57:08.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:57:12.028 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-12T15:57:18.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:57:21.084 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-12T15:57:27.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:57:30.140 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-12T15:57:36.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:57:39.196 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28
2024-02-12T15:57:45.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:57:49.109 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2024-02-12T15:58:24.625 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T15:58:31.645 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T15:58:38.653 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-02-12T15:58:41.663 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T15:58:45.199 WARNING:teuthology.provision.fog.smithi028:timed out
2024-02-12T15:58:51.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T15:58:51.451 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-12T15:58:51.452 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-12T15:58:51.754 INFO:teuthology.provision.fog.smithi028:Node is ready
2024-02-12T15:58:51.754 DEBUG:teuthology.orchestra.run.smithi028:> hostname
2024-02-12T15:58:51.775 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com
2024-02-12T15:58:51.775 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts
2024-02-12T15:58:51.836 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028
2024-02-12T15:58:51.837 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-02-12T15:58:51.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts
2024-02-12T15:58:51.981 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts
2024-02-12T15:58:52.051 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname
2024-02-12T15:58:52.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028
2024-02-12T15:58:52.191 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-02-12T15:58:52.250 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-02-12T15:58:52.250 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8"
2024-02-12T15:58:52.250 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-02-12T15:58:52.250 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-12T15:58:52.251 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-12T15:58:52.252 INFO:teuthology.provision.fog.smithi028:Deploy complete!
2024-02-12T15:58:52.253 DEBUG:teuthology.parallel:result is None
2024-02-12T15:58:54.680 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T15:59:10.698 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T15:59:29.715 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T15:59:51.734 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T16:00:16.751 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T16:00:44.769 ERROR:teuthology.orchestra.connection:Error authenticating with smithi037.front.sepia.ceph.com: BadHostKeyException('smithi037.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:Im5IwDc2v6jErvtyR32Dn2ItuguHLPhjm7TyY2s852k), PKey(alg=ED25519, bits=256, fp=SHA256:GOJbFLLtTkQRhRMstB6uh8Fwy3EKmYJvgf/ZPekNmZQ)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi037.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIH0jJzQ4kUh6eKybGLCSR7Br28pALPSpX3FQDNWo1FwGNAt4LFbtRnPBuHuBVp2iqgWpqvU+VWwdXs2a6EIIck=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHt+wZZLjo7dFcjhtnYd4mYd/sdDpMWfZBgW9ghKSPec'
2024-02-12T16:00:44.770 WARNING:teuthology.provision.fog.smithi037:'connect to smithi037.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-02-12T16:00:50.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T16:00:51.040 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-12T16:00:51.041 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-12T16:00:51.326 INFO:teuthology.provision.fog.smithi037:Node is ready
2024-02-12T16:00:51.326 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2024-02-12T16:00:51.346 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2024-02-12T16:00:51.346 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2024-02-12T16:00:51.407 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2024-02-12T16:00:51.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-02-12T16:00:51.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2024-02-12T16:00:51.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2024-02-12T16:00:51.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2024-02-12T16:00:51.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2024-02-12T16:00:51.821 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-12T16:00:51.881 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-12T16:00:51.882 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-12T16:00:51.882 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2024-02-12T16:00:51.882 DEBUG:teuthology.parallel:result is None
2024-02-12T16:00:52.035 ERROR:teuthology.misc:smithi037.front.sepia.ceph.com: Connection closed by remote host
2024-02-12T16:00:52.035 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com
2024-02-12T16:00:52.035 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-12T16:00:52.075 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2024-02-12T16:00:52.075 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-12T16:00:52.101 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server
2024-02-12T16:00:52.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-02-12T16:00:52.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T16:00:52.178 DEBUG:teuthology.orchestra.run.smithi028:> true
2024-02-12T16:00:52.323 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com'
2024-02-12T16:00:52.323 DEBUG:teuthology.orchestra.run.smithi028:> uname -m
2024-02-12T16:00:52.383 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64
2024-02-12T16:00:52.383 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="8"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="8"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el8"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/"
2024-02-12T16:00:52.443 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-12T16:00:52.444 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-12T16:00:52.444 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-12T16:00:52.444 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server
2024-02-12T16:00:52.467 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2024-02-12T16:00:52.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-02-12T16:00:52.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-12T16:00:52.542 DEBUG:teuthology.orchestra.run.smithi037:> true
2024-02-12T16:00:52.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com'
2024-02-12T16:00:52.615 DEBUG:teuthology.orchestra.run.smithi037:> uname -m
2024-02-12T16:00:52.678 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2024-02-12T16:00:52.678 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2024-02-12T16:00:52.740 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-12T16:00:52.741 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-12T16:00:52.742 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2024-02-12T16:00:52.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:00:52.857 INFO:teuthology.dispatcher.supervisor:Running job 7556669
2024-02-12T16:00:52.858 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-12_15:26:58-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7556669 --name yuriw-2024-02-12_15:26:58-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2024-02-12_15:26:58-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7556669/orig.config.yaml
2024-02-12T16:00:52.861 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-12_15:26:58-rados-wip-yuri10-testing-2024-02-08-0854-pacific-distro-default-smithi/7556669
2024-02-12T16:00:52.861 INFO:teuthology.dispatcher.supervisor:Job PID: 952462
2024-02-12T16:00:52.862 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-12T16:02:52.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:04:53.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:06:53.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:08:53.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:10:53.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:12:53.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:14:53.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:16:54.068 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:18:54.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:20:54.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:22:54.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:24:54.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:26:54.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:28:55.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:30:55.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-12T16:30:55.284 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1