2024-04-01T02:59:52.529 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T02:59:52.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T02:59:52.672 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6bdf7e6c10>, signals=[15]) 2024-04-01T02:59:52.672 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-04-01T02:59:52.673 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T02:59:52.673 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-04-01T02:59:52.693 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2024-04-01T02:59:52.693 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T02:59:52.694 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-01T02:59:52.817 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T02:59:52.840 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T02:59:52.872 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 9.stream 2024-04-01T02:59:52.891 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 9.stream 2024-04-01T02:59:53.205 INFO:teuthology.orchestra.console.smithi086:Power off 2024-04-01T02:59:53.205 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:59:53.218 INFO:teuthology.orchestra.console.smithi087:Power off 2024-04-01T02:59:53.219 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T02:59:53.229 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-04-01T02:59:53.230 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:59:53.240 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-04-01T02:59:53.240 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:59:53.254 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-04-01T02:59:53.267 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-01T02:59:57.261 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:59:57.268 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T02:59:57.370 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-04-01T02:59:57.378 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-01T03:00:01.375 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:01.383 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:01.485 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-04-01T03:00:01.493 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-01T03:00:01.587 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-04-01T03:00:01.594 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-04-01T03:00:01.688 INFO:teuthology.orchestra.console.smithi086:Power on 2024-04-01T03:00:01.688 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T03:00:01.695 INFO:teuthology.orchestra.console.smithi087:Power on 2024-04-01T03:00:01.695 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T03:00:01.711 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-04-01T03:00:01.711 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:01.720 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2024-04-01T03:00:01.721 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:01.737 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-04-01T03:00:01.741 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-01T03:00:05.742 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:05.749 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:05.852 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-04-01T03:00:05.865 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-01T03:00:05.965 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-04-01T03:00:06.065 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-04-01T03:00:09.869 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T03:00:09.979 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-01T03:00:10.079 INFO:teuthology.orchestra.console.smithi087:Power on completed 2024-04-01T03:00:10.180 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2024-04-01T03:02:36.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:02:41.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:02:44.062 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-01T03:02:50.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:02:53.122 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-01T03:02:59.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:03:02.178 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-01T03:03:08.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:03:11.230 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-01T03:03:17.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:03:20.290 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-01T03:03:26.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:03:29.342 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-01T03:03:35.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:04:07.367 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-04-01T03:04:26.877 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:04:29.214 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-01T03:04:33.899 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:04:35.346 WARNING:teuthology.provision.fog.smithi087:timed out 2024-04-01T03:04:41.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:04:41.576 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T03:04:41.577 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T03:04:41.870 INFO:teuthology.provision.fog.smithi087:Node is ready 2024-04-01T03:04:41.871 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2024-04-01T03:04:41.887 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2024-04-01T03:04:41.888 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2024-04-01T03:04:41.943 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2024-04-01T03:04:41.944 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2024-04-01T03:04:42.058 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2024-04-01T03:04:42.087 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2024-04-01T03:04:42.155 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2024-04-01T03:04:42.222 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2024-04-01T03:04:42.288 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-01T03:04:42.342 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T03:04:42.343 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T03:04:42.344 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T03:04:42.344 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2024-04-01T03:04:42.346 DEBUG:teuthology.parallel:result is None 2024-04-01T03:04:43.919 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:04:56.938 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:05:12.958 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:05:31.979 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:05:53.998 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:06:19.019 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:06:47.037 ERROR:teuthology.orchestra.connection:Error authenticating with smithi086.front.sepia.ceph.com: BadHostKeyException('smithi086.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:XCgC6QZa0hjUzK3jXLqBScas6Gv8CmfcY3KXgPfYXCY), PKey(alg=ED25519, bits=256, fp=SHA256:oMVymBZKRrF0Bb8QGaDxB3A/HL5CX0yvadxMM4Bumkw)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi086.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH7i2jufUT/rWD5RHueOrfmrzo8B8fqXlCOCgFgYK86gVMX5o3i3Itd2epHWyvyv61RwRn+BAYX8Ow1ZvuEhrcU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIGZ1q5wv5BMcv6h5lyLk1XuwdBCCjYgir5HBACMVIfth' 2024-04-01T03:06:47.038 WARNING:teuthology.provision.fog.smithi086:'connect to smithi086.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-04-01T03:06:53.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:06:53.279 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T03:06:53.279 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T03:06:53.639 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-04-01T03:06:53.639 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-04-01T03:06:53.654 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2024-04-01T03:06:53.654 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2024-04-01T03:06:53.710 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2024-04-01T03:06:53.710 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-04-01T03:06:53.810 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2024-04-01T03:06:53.837 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2024-04-01T03:06:53.904 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2024-04-01T03:06:53.970 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-04-01T03:06:54.036 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T03:06:54.091 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-04-01T03:06:54.092 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-04-01T03:06:54.092 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T03:06:54.092 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-04-01T03:06:54.092 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T03:06:54.092 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T03:06:54.092 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T03:06:54.092 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-04-01T03:06:54.093 DEBUG:teuthology.parallel:result is None 2024-04-01T03:06:54.255 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-04-01T03:06:54.256 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T03:06:54.281 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2024-04-01T03:06:54.281 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T03:06:54.307 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-04-01T03:06:54.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-01T03:06:54.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:06:54.398 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-04-01T03:06:54.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-01T03:06:54.468 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-04-01T03:06:54.522 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-04-01T03:06:54.522 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-04-01T03:06:54.577 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-04-01T03:06:54.577 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-04-01T03:06:54.577 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-04-01T03:06:54.577 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-04-01T03:06:54.577 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-04-01T03:06:54.577 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T03:06:54.578 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T03:06:54.578 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-04-01T03:06:54.598 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2024-04-01T03:06:54.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-01T03:06:54.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T03:06:54.687 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-01T03:06:54.856 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-01T03:06:54.857 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-04-01T03:06:54.911 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-04-01T03:06:54.911 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-01T03:06:54.966 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-04-01T03:06:54.966 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="9" 2024-04-01T03:06:54.966 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-04-01T03:06:54.966 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="9" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el9" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:LOGO="fedora-logo-icon" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T03:06:54.967 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T03:06:54.968 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-01T03:06:55.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:06:55.119 INFO:teuthology.dispatcher.supervisor:Running job 7633325 2024-04-01T03:06:55.119 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633325 --name teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633325/orig.config.yaml 2024-04-01T03:06:55.123 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-31_21:24:02-fs-squid-distro-default-smithi/7633325 2024-04-01T03:06:55.123 INFO:teuthology.dispatcher.supervisor:Job PID: 3785332 2024-04-01T03:06:55.123 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T03:08:55.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:10:55.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:12:55.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:14:55.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:16:55.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:18:55.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:20:56.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:22:56.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:24:56.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:26:56.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:28:56.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:30:57.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:32:57.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:34:57.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:36:57.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:38:57.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:40:57.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:42:58.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:44:58.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:46:58.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:48:58.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:50:58.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:52:58.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:54:59.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:56:59.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T03:58:59.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:00:59.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:02:59.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:04:59.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:07:00.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:09:00.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:11:00.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:13:00.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T04:13:00.655 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1