2024-04-01T11:10:01.746 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T11:10:01.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:10:01.878 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ee52d8c10>, signals=[15]) 2024-04-01T11:10:01.879 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2024-04-01T11:10:01.879 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T11:10:01.879 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-01T11:10:01.897 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2024-04-01T11:10:01.898 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T11:10:01.898 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-01T11:10:02.015 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T11:10:02.029 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T11:10:02.056 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream 2024-04-01T11:10:02.073 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 9.stream 2024-04-01T11:10:02.323 INFO:teuthology.orchestra.console.smithi137:Power off 2024-04-01T11:10:02.323 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T11:10:02.336 INFO:teuthology.orchestra.console.smithi117:Power off 2024-04-01T11:10:02.337 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T11:10:02.345 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-04-01T11:10:02.345 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:02.357 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2024-04-01T11:10:02.357 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:02.368 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-01T11:10:02.381 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-01T11:10:02.470 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-04-01T11:10:02.482 INFO:teuthology.orchestra.console.smithi117:Power off completed 2024-04-01T11:10:02.571 INFO:teuthology.orchestra.console.smithi137:Power on 2024-04-01T11:10:02.571 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T11:10:02.583 INFO:teuthology.orchestra.console.smithi117:Power on 2024-04-01T11:10:02.584 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T11:10:02.594 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2024-04-01T11:10:02.594 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:02.606 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On 2024-04-01T11:10:02.606 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:02.616 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-01T11:10:02.626 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-01T11:10:06.618 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:06.627 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:06.727 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-04-01T11:10:06.736 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2024-04-01T11:10:10.730 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:10.737 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T11:10:10.839 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-04-01T11:10:10.845 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2024-04-01T11:10:10.940 INFO:teuthology.orchestra.console.smithi137:Power on completed 2024-04-01T11:10:10.946 INFO:teuthology.orchestra.console.smithi117:Power on completed 2024-04-01T11:10:11.041 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2024-04-01T11:10:11.047 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2024-04-01T11:12:42.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:12:57.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:00.286 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:13:06.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:09.342 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:13:15.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:18.400 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:13:24.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:27.454 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:13:33.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:36.513 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:13:42.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:45.566 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:13:51.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:13:54.622 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-04-01T11:14:00.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:14:12.465 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2024-04-01T11:14:31.948 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:14:39.197 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:14:49.216 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:14:54.878 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-04-01T11:15:00.625 WARNING:teuthology.provision.fog.smithi117:timed out 2024-04-01T11:15:02.235 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:15:06.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:15:06.960 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T11:15:06.960 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T11:15:07.318 INFO:teuthology.provision.fog.smithi117:Node is ready 2024-04-01T11:15:07.318 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2024-04-01T11:15:07.333 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2024-04-01T11:15:07.333 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2024-04-01T11:15:07.389 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2024-04-01T11:15:07.389 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2024-04-01T11:15:07.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2024-04-01T11:15:07.516 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2024-04-01T11:15:07.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2024-04-01T11:15:07.650 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2024-04-01T11:15:07.717 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-01T11:15:07.771 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-04-01T11:15:07.772 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T11:15:07.772 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-04-01T11:15:07.772 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T11:15:07.772 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T11:15:07.772 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T11:15:07.772 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2024-04-01T11:15:07.774 DEBUG:teuthology.parallel:result is None 2024-04-01T11:15:18.253 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:15:37.272 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:15:59.291 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:16:24.310 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:16:52.329 ERROR:teuthology.orchestra.connection:Error authenticating with smithi137.front.sepia.ceph.com: BadHostKeyException('smithi137.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:kUyOwrXcbiZefYQ5NcomQD248+2VYRcaP48ylc0CqA4), PKey(alg=ED25519, bits=256, fp=SHA256:q+FeAg7AKhW+R26rEWssb2lyFXiL3m6pJJ4/4+WsOZ8)) (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect raise BadHostKeyException(hostname, server_key, our_key) paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi137.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDc3caX6RAAkIQL85b17mTjR0iFTv0SAsQzUJrREAYbvudk8Q+vhjk1jIyhnbe+5nCYMsjyztUrgcTIY+jjyVg=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIOCp4OPKs+y5qT1xbOPoDJHCAUeyK0fsbWxy3/jkUxFN' 2024-04-01T11:16:52.330 WARNING:teuthology.provision.fog.smithi137:'connect to smithi137.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds 2024-04-01T11:16:58.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:16:58.548 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T11:16:58.549 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T11:16:58.871 INFO:teuthology.provision.fog.smithi137:Node is ready 2024-04-01T11:16:58.872 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2024-04-01T11:16:58.889 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2024-04-01T11:16:58.890 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2024-04-01T11:16:58.945 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2024-04-01T11:16:58.945 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-04-01T11:16:59.071 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2024-04-01T11:16:59.100 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2024-04-01T11:16:59.168 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2024-04-01T11:16:59.235 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-04-01T11:16:59.301 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-01T11:16:59.356 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-01T11:16:59.356 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-01T11:16:59.356 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-01T11:16:59.356 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T11:16:59.357 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T11:16:59.358 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2024-04-01T11:16:59.358 DEBUG:teuthology.parallel:result is None 2024-04-01T11:16:59.522 ERROR:teuthology.misc:smithi137.front.sepia.ceph.com: Connection closed by remote host 2024-04-01T11:16:59.522 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2024-04-01T11:16:59.522 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T11:16:59.548 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2024-04-01T11:16:59.549 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T11:16:59.574 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2024-04-01T11:16:59.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-01T11:16:59.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:16:59.666 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-04-01T11:16:59.832 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-04-01T11:16:59.833 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-04-01T11:16:59.887 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-04-01T11:16:59.888 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-04-01T11:16:59.943 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-04-01T11:16:59.943 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-04-01T11:16:59.943 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-04-01T11:16:59.943 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T11:16:59.944 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T11:16:59.945 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-04-01T11:16:59.965 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2024-04-01T11:16:59.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-01T11:16:59.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:17:00.053 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-04-01T11:17:00.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-04-01T11:17:00.124 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-04-01T11:17:00.179 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-04-01T11:17:00.179 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-04-01T11:17:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-04-01T11:17:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="9" 2024-04-01T11:17:00.233 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="9" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el9" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:LOGO="fedora-logo-icon" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T11:17:00.234 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T11:17:00.235 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-04-01T11:17:00.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:17:00.367 INFO:teuthology.dispatcher.supervisor:Running job 7626144 2024-04-01T11:17:00.367 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdiazbou@teuthology --archive /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626144 --name pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-1} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} -- /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626144/orig.config.yaml 2024-04-01T11:17:00.371 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626144 2024-04-01T11:17:00.371 INFO:teuthology.dispatcher.supervisor:Job PID: 2203357 2024-04-01T11:17:00.371 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T11:19:00.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:21:00.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:23:00.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:25:00.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:27:01.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:29:01.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:31:01.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:33:01.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:35:01.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:37:01.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:37:01.967 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1