2024-03-17T03:37:15.909 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-17T03:37:15.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:37:16.050 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f458dd9fc10>, signals=[15]) 2024-03-17T03:37:16.051 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2024-03-17T03:37:16.051 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T03:37:16.051 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-03-17T03:37:16.073 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2024-03-17T03:37:16.073 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2024-03-17T03:37:16.073 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-03-17T03:37:16.209 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_centos_9.stream (ID 10) 2024-03-17T03:37:16.217 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_9.stream (ID 10) 2024-03-17T03:37:16.255 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 9.stream 2024-03-17T03:37:16.262 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of centos 9.stream 2024-03-17T03:37:16.471 INFO:teuthology.orchestra.console.smithi049:Power off 2024-03-17T03:37:16.472 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T03:37:16.484 INFO:teuthology.orchestra.console.smithi111:Power off 2024-03-17T03:37:16.485 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-17T03:37:16.493 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-03-17T03:37:16.493 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:16.506 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-03-17T03:37:16.506 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:16.515 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-17T03:37:16.527 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-17T03:37:20.519 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:20.527 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:20.629 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-17T03:37:20.636 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-17T03:37:24.634 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:24.641 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:24.744 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-03-17T03:37:24.750 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-17T03:37:24.845 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-03-17T03:37:24.946 INFO:teuthology.orchestra.console.smithi049:Power on 2024-03-17T03:37:24.946 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T03:37:24.967 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2024-03-17T03:37:24.968 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:24.990 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-03-17T03:37:28.754 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:28.863 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-03-17T03:37:28.963 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-03-17T03:37:28.992 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:29.064 INFO:teuthology.orchestra.console.smithi111:Power on 2024-03-17T03:37:29.065 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-17T03:37:29.085 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On 2024-03-17T03:37:29.086 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:29.100 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-03-17T03:37:29.106 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-03-17T03:37:33.106 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:33.113 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:33.216 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-03-17T03:37:33.222 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-03-17T03:37:33.317 INFO:teuthology.orchestra.console.smithi049:Power on completed 2024-03-17T03:37:33.417 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2024-03-17T03:37:37.227 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-17T03:37:37.335 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-03-17T03:37:37.436 INFO:teuthology.orchestra.console.smithi111:Power on completed 2024-03-17T03:37:37.537 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2024-03-17T03:40:23.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T03:40:49.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T03:41:53.812 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-03-17T03:42:19.879 ERROR:teuthology.orchestra.connection:Error authenticating with smithi049.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-03-17T03:42:25.566 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-17T03:42:29.461 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:42:36.481 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:42:46.500 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:42:59.519 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:43:15.537 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:43:23.884 WARNING:teuthology.provision.fog.smithi049:timed out 2024-03-17T03:43:29.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T03:43:30.118 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T03:43:30.119 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T03:43:30.488 INFO:teuthology.provision.fog.smithi049:Node is ready 2024-03-17T03:43:30.489 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2024-03-17T03:43:30.504 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2024-03-17T03:43:30.504 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2024-03-17T03:43:30.561 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2024-03-17T03:43:30.561 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-03-17T03:43:30.676 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2024-03-17T03:43:30.709 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2024-03-17T03:43:30.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2024-03-17T03:43:30.851 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-03-17T03:43:30.921 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T03:43:30.976 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-03-17T03:43:30.977 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-03-17T03:43:30.977 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T03:43:30.977 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-03-17T03:43:30.977 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T03:43:30.977 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T03:43:30.977 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T03:43:30.977 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2024-03-17T03:43:30.979 DEBUG:teuthology.parallel:result is None 2024-03-17T03:43:34.556 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:43:56.575 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:43:59.774 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-03-17T03:44:21.595 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:44:49.614 ERROR:teuthology.orchestra.connection:Error authenticating with smithi111.front.sepia.ceph.com: BadHostKeyException('smithi111.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:tAJwcNqY80pgfKojWgcS7+NzswnP33ucFod6/dlQA+s), PKey(alg=ED25519, bits=256, fp=SHA256:VHfQd8wND7j5y9MBLodUYtawvnW41Nrmw0BV6op6tCc)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi111.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQ+1PZ1G8q+T3MRjziGuYtVXiNBv9oO5IlpJk5hazoZevAxi2kxzJajJadnM4xMgX3hl7Cg2F9yZf2u3lle8pU=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOoNcvKmpBPEb9ekO9Ga/BZN+G9qd4n9oR60IVavhh8r' 2024-03-17T03:44:49.614 WARNING:teuthology.provision.fog.smithi111:'connect to smithi111.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-03-17T03:44:55.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T03:44:55.823 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-17T03:44:55.823 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-17T03:44:56.183 INFO:teuthology.provision.fog.smithi111:Node is ready 2024-03-17T03:44:56.183 DEBUG:teuthology.orchestra.run.smithi111:> hostname 2024-03-17T03:44:56.198 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2024-03-17T03:44:56.198 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts 2024-03-17T03:44:56.254 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2024-03-17T03:44:56.254 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-03-17T03:44:56.354 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts 2024-03-17T03:44:56.382 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts 2024-03-17T03:44:56.450 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname 2024-03-17T03:44:56.517 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111 2024-03-17T03:44:56.583 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-03-17T03:44:56.637 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T03:44:56.638 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T03:44:56.639 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2024-03-17T03:44:56.639 DEBUG:teuthology.parallel:result is None 2024-03-17T03:44:56.808 ERROR:teuthology.misc:smithi111.front.sepia.ceph.com: Connection closed by remote host 2024-03-17T03:44:56.808 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2024-03-17T03:44:56.808 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T03:44:56.833 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2024-03-17T03:44:56.833 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-17T03:44:56.851 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2024-03-17T03:44:56.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-17T03:44:56.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T03:44:56.950 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-03-17T03:44:57.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-03-17T03:44:57.132 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-03-17T03:44:57.187 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-03-17T03:44:57.187 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-03-17T03:44:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-03-17T03:44:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-03-17T03:44:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-03-17T03:44:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-03-17T03:44:57.242 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T03:44:57.243 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T03:44:57.243 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-03-17T03:44:57.267 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2024-03-17T03:44:57.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-03-17T03:44:57.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-17T03:44:57.350 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-03-17T03:44:57.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-03-17T03:44:57.417 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-03-17T03:44:57.471 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-03-17T03:44:57.471 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-17T03:44:57.526 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-03-17T03:44:57.527 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-03-17T03:44:57.527 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-17T03:44:57.527 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-03-17T03:44:57.527 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-17T03:44:57.527 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-17T03:44:57.527 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-17T03:44:57.527 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-03-17T03:44:57.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:44:57.640 INFO:teuthology.dispatcher.supervisor:Running job 7595777 2024-03-17T03:44:57.640 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-12_21:40:02-rgw-squid-distro-default-smithi/7595777 --name teuthology-2024-03-12_21:40:02-rgw-squid-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/teuthology-2024-03-12_21:40:02-rgw-squid-distro-default-smithi/7595777/orig.config.yaml 2024-03-17T03:44:57.644 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-12_21:40:02-rgw-squid-distro-default-smithi/7595777 2024-03-17T03:44:57.644 INFO:teuthology.dispatcher.supervisor:Job PID: 1175330 2024-03-17T03:44:57.644 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-17T03:46:57.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:48:57.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:50:58.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:52:58.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:54:58.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:56:58.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T03:58:58.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:00:58.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:02:59.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:04:59.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:06:59.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:08:59.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:10:59.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:12:59.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:15:00.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:17:00.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:19:00.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:21:00.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:23:00.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:25:00.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:27:01.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:29:01.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:31:01.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:33:01.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:35:01.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:37:01.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:39:02.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:41:02.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:43:02.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:45:02.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:47:02.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:49:02.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:51:03.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:53:03.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:55:03.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-17T04:55:03.494 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1