2024-03-24T00:17:15.630 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-24T00:17:15.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:17:15.762 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb6621bbf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb66321cc10>, signals=[15])
2024-03-24T00:17:15.762 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2024-03-24T00:17:15.763 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T00:17:15.763 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2024-03-24T00:17:15.784 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2024-03-24T00:17:15.784 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2024-03-24T00:17:15.784 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-03-24T00:17:15.905 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T00:17:15.907 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_9.stream (ID 10)
2024-03-24T00:17:15.945 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 9.stream
2024-03-24T00:17:15.951 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 9.stream
2024-03-24T00:17:16.254 INFO:teuthology.orchestra.console.smithi072:Power off
2024-03-24T00:17:16.254 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T00:17:16.267 INFO:teuthology.orchestra.console.smithi067:Power off
2024-03-24T00:17:16.267 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-24T00:17:16.276 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2024-03-24T00:17:16.277 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:16.287 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off
2024-03-24T00:17:16.287 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:16.299 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-03-24T00:17:16.308 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-03-24T00:17:20.302 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:20.310 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:20.412 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-03-24T00:17:20.419 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-03-24T00:17:24.415 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:24.422 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:24.524 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-03-24T00:17:24.531 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-03-24T00:17:28.529 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:28.536 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:28.639 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-03-24T00:17:28.644 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2024-03-24T00:17:28.740 INFO:teuthology.orchestra.console.smithi072:Power off completed
2024-03-24T00:17:28.745 INFO:teuthology.orchestra.console.smithi067:Power off completed
2024-03-24T00:17:28.841 INFO:teuthology.orchestra.console.smithi072:Power on
2024-03-24T00:17:28.841 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T00:17:28.848 INFO:teuthology.orchestra.console.smithi067:Power on
2024-03-24T00:17:28.848 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-24T00:17:28.862 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On
2024-03-24T00:17:28.862 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:28.870 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On
2024-03-24T00:17:28.871 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:28.883 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-03-24T00:17:28.890 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2024-03-24T00:17:32.888 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:32.895 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:32.998 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2024-03-24T00:17:33.004 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2024-03-24T00:17:33.104 INFO:teuthology.orchestra.console.smithi067:Power on completed
2024-03-24T00:17:33.205 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2024-03-24T00:17:37.002 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-24T00:17:37.111 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2024-03-24T00:17:37.212 INFO:teuthology.orchestra.console.smithi072:Power on completed
2024-03-24T00:17:37.313 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2024-03-24T00:20:19.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:20:37.535 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-03-24T00:20:38.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:20:43.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:20:46.591 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-03-24T00:20:52.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:20:55.646 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-03-24T00:21:01.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:21:04.702 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-03-24T00:21:10.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:21:13.758 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-03-24T00:21:19.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:21:22.814 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2024-03-24T00:21:28.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:22:09.300 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2024-03-24T00:22:28.818 WARNING:teuthology.provision.fog.smithi067:timed out
2024-03-24T00:22:34.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:22:35.048 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T00:22:35.049 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T00:22:35.377 INFO:teuthology.provision.fog.smithi067:Node is ready
2024-03-24T00:22:35.377 DEBUG:teuthology.orchestra.run.smithi067:> hostname
2024-03-24T00:22:35.392 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2024-03-24T00:22:35.392 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts
2024-03-24T00:22:35.451 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2024-03-24T00:22:35.451 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2024-03-24T00:22:35.569 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts
2024-03-24T00:22:35.600 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts
2024-03-24T00:22:35.674 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname
2024-03-24T00:22:35.749 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2024-03-24T00:22:35.822 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2024-03-24T00:22:35.882 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T00:22:35.883 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T00:22:35.883 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T00:22:35.883 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2024-03-24T00:22:35.885 DEBUG:teuthology.parallel:result is None
2024-03-24T00:22:44.904 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:22:49.886 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2024-03-24T00:22:51.925 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:23:01.945 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:23:14.965 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:23:30.984 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:23:50.005 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:24:12.025 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:24:37.043 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:25:05.063 ERROR:teuthology.orchestra.connection:Error authenticating with smithi072.front.sepia.ceph.com: BadHostKeyException('smithi072.front.sepia.ceph.com', PKey(alg=ECDSA, bits=256, fp=SHA256:pSUw9Cne2aqxq+F1BBvcJVLdPseO8P7yD+INMpUiKcU), PKey(alg=ED25519, bits=256, fp=SHA256:OBu7Rk/oEh8g5eyueon6vM+r3B82ZhrlHFYURAfohq8)) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 468, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi072.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHKZ2OBRMHPdFxGrk+8dJ5aBUfN0YoKZJ/yHulR5ozeKvvv8ePCbz4UDpFjr7jPvwgWT4STFERjN8cT9GeVy2Ps=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAILzFk4HYAWx2robjVU8YUI8GoXR2Mmab/1rFE1LyHnOM'
2024-03-24T00:25:05.063 WARNING:teuthology.provision.fog.smithi072:'connect to smithi072.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-03-24T00:25:11.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:25:11.278 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-24T00:25:11.278 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-24T00:25:11.673 INFO:teuthology.provision.fog.smithi072:Node is ready
2024-03-24T00:25:11.673 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2024-03-24T00:25:11.688 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com
2024-03-24T00:25:11.689 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts
2024-03-24T00:25:11.744 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072
2024-03-24T00:25:11.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-03-24T00:25:11.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts
2024-03-24T00:25:11.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts
2024-03-24T00:25:11.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname
2024-03-24T00:25:12.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2024-03-24T00:25:12.091 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon"
2024-03-24T00:25:12.146 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T00:25:12.147 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/"
2024-03-24T00:25:12.147 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T00:25:12.147 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T00:25:12.147 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T00:25:12.147 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2024-03-24T00:25:12.148 DEBUG:teuthology.parallel:result is None
2024-03-24T00:25:12.319 ERROR:teuthology.misc:smithi072.front.sepia.ceph.com: Connection closed by remote host
2024-03-24T00:25:12.320 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com
2024-03-24T00:25:12.320 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T00:25:12.347 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com
2024-03-24T00:25:12.347 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-24T00:25:12.364 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server
2024-03-24T00:25:12.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com'
2024-03-24T00:25:12.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:25:12.468 DEBUG:teuthology.orchestra.run.smithi067:> true
2024-03-24T00:25:12.645 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com'
2024-03-24T00:25:12.645 DEBUG:teuthology.orchestra.run.smithi067:> uname -m
2024-03-24T00:25:12.700 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64
2024-03-24T00:25:12.700 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2024-03-24T00:25:12.754 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream"
2024-03-24T00:25:12.754 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="9"
2024-03-24T00:25:12.754 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="9"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el9"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:LOGO="fedora-logo-icon"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T00:25:12.755 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T00:25:12.756 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2024-03-24T00:25:12.780 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server
2024-03-24T00:25:12.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-03-24T00:25:12.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-24T00:25:12.867 DEBUG:teuthology.orchestra.run.smithi072:> true
2024-03-24T00:25:12.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com'
2024-03-24T00:25:12.936 DEBUG:teuthology.orchestra.run.smithi072:> uname -m
2024-03-24T00:25:12.991 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64
2024-03-24T00:25:12.991 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2024-03-24T00:25:13.045 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream"
2024-03-24T00:25:13.045 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-03-24T00:25:13.046 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-03-24T00:25:13.047 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2024-03-24T00:25:13.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:25:13.165 INFO:teuthology.dispatcher.supervisor:Running job 7616442
2024-03-24T00:25:13.165 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616442 --name mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} -- /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616442/orig.config.yaml
2024-03-24T00:25:13.168 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-22_09:49:57-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7616442
2024-03-24T00:25:13.169 INFO:teuthology.dispatcher.supervisor:Job PID: 2851642
2024-03-24T00:25:13.169 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-24T00:27:13.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:29:13.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:31:13.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:33:13.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:35:13.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:37:14.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:39:14.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:41:14.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:43:14.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:45:14.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:47:14.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:49:15.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:51:15.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-24T00:51:15.249 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1