2023-12-20T04:34:08.078 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-20T04:34:08.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:34:08.254 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe71ae012e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe71bd5a940>, signals=[15])
2023-12-20T04:34:08.254 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging
2023-12-20T04:34:08.254 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T04:34:08.255 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-12-20T04:34:08.284 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging
2023-12-20T04:34:08.284 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T04:34:08.284 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2023-12-20T04:34:08.310 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging
2023-12-20T04:34:08.310 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T04:34:08.310 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-12-20T04:34:08.421 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T04:34:08.424 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T04:34:08.437 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T04:34:08.469 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6
2023-12-20T04:34:08.477 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of rhel 8.6
2023-12-20T04:34:08.487 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.6
2023-12-20T04:34:08.993 INFO:teuthology.orchestra.console.smithi183:Power off
2023-12-20T04:34:08.993 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:34:09.017 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-12-20T04:34:09.017 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:09.036 INFO:teuthology.orchestra.console.smithi076:Power off
2023-12-20T04:34:09.036 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:34:09.048 INFO:teuthology.orchestra.console.smithi007:Power off
2023-12-20T04:34:09.048 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:34:09.058 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-20T04:34:09.064 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off
2023-12-20T04:34:09.064 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:09.075 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-12-20T04:34:09.075 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:09.088 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-20T04:34:09.097 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-20T04:34:09.159 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-12-20T04:34:09.189 INFO:teuthology.orchestra.console.smithi076:Power off completed
2023-12-20T04:34:09.197 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-12-20T04:34:09.261 INFO:teuthology.orchestra.console.smithi183:Power on
2023-12-20T04:34:09.261 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T04:34:09.284 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On
2023-12-20T04:34:09.284 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:09.293 INFO:teuthology.orchestra.console.smithi076:Power on
2023-12-20T04:34:09.293 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T04:34:09.300 INFO:teuthology.orchestra.console.smithi007:Power on
2023-12-20T04:34:09.300 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T04:34:09.309 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-20T04:34:09.313 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On
2023-12-20T04:34:09.314 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:09.323 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On
2023-12-20T04:34:09.324 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:09.334 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-20T04:34:09.345 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-20T04:34:13.313 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:13.335 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:13.346 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:13.427 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-20T04:34:13.444 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-20T04:34:13.457 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-20T04:34:17.431 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:17.445 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:17.458 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:34:17.540 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on
2023-12-20T04:34:17.553 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on
2023-12-20T04:34:17.568 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-12-20T04:34:17.641 INFO:teuthology.orchestra.console.smithi183:Power on completed
2023-12-20T04:34:17.654 INFO:teuthology.orchestra.console.smithi076:Power on completed
2023-12-20T04:34:17.669 INFO:teuthology.orchestra.console.smithi007:Power on completed
2023-12-20T04:34:17.742 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish
2023-12-20T04:34:17.755 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish
2023-12-20T04:34:17.769 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2023-12-20T04:36:48.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:36:48.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:36:51.730 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-20T04:36:51.761 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:36:57.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:36:57.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:00.817 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-20T04:37:00.821 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:37:03.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:06.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:06.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:09.873 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-20T04:37:09.877 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:37:15.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:15.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:18.929 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-20T04:37:18.933 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:37:24.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:24.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:27.989 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-20T04:37:27.990 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:37:33.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:33.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:37.045 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-12-20T04:37:37.073 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:37:43.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:43.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:37:46.133 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183
2023-12-20T04:37:52.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:38:33.995 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-12-20T04:38:43.049 WARNING:teuthology.provision.fog.smithi007:timed out
2023-12-20T04:38:49.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:38:49.269 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:38:49.270 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:38:49.544 INFO:teuthology.provision.fog.smithi007:Node is ready
2023-12-20T04:38:49.545 DEBUG:teuthology.orchestra.run.smithi007:> hostname
2023-12-20T04:38:49.566 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2023-12-20T04:38:49.566 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts
2023-12-20T04:38:49.627 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2023-12-20T04:38:49.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-12-20T04:38:49.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts
2023-12-20T04:38:49.773 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts
2023-12-20T04:38:49.847 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname
2023-12-20T04:38:49.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-12-20T04:38:49.997 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-12-20T04:38:50.058 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:38:50.058 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:38:50.058 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:38:50.059 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:38:50.060 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2023-12-20T04:38:50.061 DEBUG:teuthology.parallel:result is None
2023-12-20T04:38:52.137 WARNING:teuthology.provision.fog.smithi183:timed out
2023-12-20T04:38:55.478 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-12-20T04:38:55.522 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a9aca00>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:38:58.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:38:58.498 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:38:58.498 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:38:58.755 INFO:teuthology.provision.fog.smithi183:Node is ready
2023-12-20T04:38:58.755 DEBUG:teuthology.orchestra.run.smithi183:> hostname
2023-12-20T04:38:58.774 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183
2023-12-20T04:38:58.774 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183 /etc/hosts
2023-12-20T04:38:58.832 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183
2023-12-20T04:38:58.833 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-12-20T04:38:58.950 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183/smithi183/g' /etc/hosts
2023-12-20T04:38:58.979 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts
2023-12-20T04:38:59.047 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183/smithi183/g' /etc/hostname
2023-12-20T04:38:59.114 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183
2023-12-20T04:38:59.181 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-12-20T04:38:59.239 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:38:59.239 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:38:59.240 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:38:59.241 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:38:59.241 INFO:teuthology.provision.fog.smithi183:Deploy complete!
2023-12-20T04:38:59.241 DEBUG:teuthology.parallel:result is None
2023-12-20T04:39:02.553 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a8f5e20>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:39:12.570 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a89b8b0>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:39:25.588 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a524a30>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:39:41.607 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a8f0790>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:40:00.624 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a8f5580>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:40:22.641 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a89be50>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:40:47.658 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a89f820>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:41:15.675 ERROR:teuthology.orchestra.connection:Error authenticating with smithi076.front.sepia.ceph.com: BadHostKeyException('smithi076.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7fe71a89fe80>, <paramiko.ed25519key.Ed25519Key object at 0x7fe71a9ead60>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi076.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIHAQCgdQ3V5NcJV1roIf0WXXVeXYFUk4wWmbDSoQBGwL'
2023-12-20T04:41:15.676 WARNING:teuthology.provision.fog.smithi076:'connect to smithi076.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-20T04:41:21.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:41:22.053 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:41:22.053 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:41:22.350 INFO:teuthology.provision.fog.smithi076:Node is ready
2023-12-20T04:41:22.350 DEBUG:teuthology.orchestra.run.smithi076:> hostname
2023-12-20T04:41:22.369 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076
2023-12-20T04:41:22.369 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076 /etc/hosts
2023-12-20T04:41:22.430 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076
2023-12-20T04:41:22.430 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076
2023-12-20T04:41:22.552 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076/smithi076/g' /etc/hosts
2023-12-20T04:41:22.582 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts
2023-12-20T04:41:22.651 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076/smithi076/g' /etc/hostname
2023-12-20T04:41:22.720 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076
2023-12-20T04:41:22.787 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.6"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31"
2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:41:22.845 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:41:22.845 INFO:teuthology.provision.fog.smithi076:Deploy complete!
2023-12-20T04:41:22.846 DEBUG:teuthology.parallel:result is None
2023-12-20T04:41:23.044 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2023-12-20T04:41:23.044 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:41:23.069 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com
2023-12-20T04:41:23.069 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:41:23.085 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com
2023-12-20T04:41:23.085 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:41:23.103 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:41:23.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-12-20T04:41:23.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:41:23.177 DEBUG:teuthology.orchestra.run.smithi007:> true
2023-12-20T04:41:23.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-12-20T04:41:23.327 DEBUG:teuthology.orchestra.run.smithi007:> uname -m
2023-12-20T04:41:23.389 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2023-12-20T04:41:23.389 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-12-20T04:41:23.450 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:41:23.450 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:41:23.450 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2023-12-20T04:41:23.450 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:41:23.451 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:41:23.452 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-12-20T04:41:23.477 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:41:23.477 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com'
2023-12-20T04:41:23.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:41:23.545 DEBUG:teuthology.orchestra.run.smithi076:> true
2023-12-20T04:41:23.615 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com'
2023-12-20T04:41:23.615 DEBUG:teuthology.orchestra.run.smithi076:> uname -m
2023-12-20T04:41:23.673 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64
2023-12-20T04:41:23.673 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:ID="rhel"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="fedora"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8.6"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:41:23.731 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:41:23.732 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:41:23.732 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2023-12-20T04:41:23.752 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:41:23.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-12-20T04:41:23.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:41:23.818 DEBUG:teuthology.orchestra.run.smithi183:> true
2023-12-20T04:41:23.955 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com'
2023-12-20T04:41:23.955 DEBUG:teuthology.orchestra.run.smithi183:> uname -m
2023-12-20T04:41:24.013 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64
2023-12-20T04:41:24.013 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:41:24.071 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:41:24.072 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:41:24.073 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server
2023-12-20T04:41:24.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:41:24.194 INFO:teuthology.dispatcher.supervisor:Running job 7497472
2023-12-20T04:41:24.194 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497472 --name vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497472/orig.config.yaml
2023-12-20T04:41:24.197 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497472
2023-12-20T04:41:24.198 INFO:teuthology.dispatcher.supervisor:Job PID: 4088071
2023-12-20T04:41:24.198 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-20T04:43:24.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:45:24.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:47:24.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:49:24.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:51:24.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:53:25.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:55:25.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:57:25.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:57:25.425 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-20T04:57:25.577 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-20T04:57:25.578 INFO:teuthology.nuke:Checking targets against current locks
2023-12-20T04:57:25.631 DEBUG:teuthology.nuke:shortname: smithi007
2023-12-20T04:57:25.631 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:57:25.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497472', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:34:07.176145', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBk8WrY/7yqVzS0K01EVwG1KToHDEw7MwSHSiwTd8CUB0v/y1flNBAZxo06Mxd2Fechju2+XUVyTTsn0wuwNA5Y='}
2023-12-20T04:57:25.656 DEBUG:teuthology.nuke:shortname: smithi076
2023-12-20T04:57:25.657 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:57:25.666 DEBUG:teuthology.nuke:shortname: smithi183
2023-12-20T04:57:25.667 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:57:25.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497472', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:34:07.177289', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAxqLQr4Mpee5kra8Nclq6Wpp1AlidopFrI68Wf7N3Ayc/mV4GUUvRaicgfBN5yrTEp1O00d9p79KIEeWSZZR2Q='}
2023-12-20T04:57:25.684 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497472', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:34:07.174624', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLsiglTZEcYucNwfDz0nlrEBWcqW/jGyS1coQw01VAJuqu2o6tOqIiUAh6SkuT6uRPS39D+P4mwNU32UlFtlFzY='}
2023-12-20T04:57:25.697 INFO:teuthology.orchestra.console.smithi007:Power off
2023-12-20T04:57:25.697 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:57:25.720 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-12-20T04:57:25.721 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:57:25.738 INFO:teuthology.orchestra.console.smithi183:Power off
2023-12-20T04:57:25.739 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:57:25.752 INFO:teuthology.orchestra.console.smithi076:Power off
2023-12-20T04:57:25.752 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:57:25.759 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-12-20T04:57:25.761 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off
2023-12-20T04:57:25.761 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:57:25.773 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off
2023-12-20T04:57:25.773 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:57:25.782 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off
2023-12-20T04:57:25.793 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off
2023-12-20T04:57:25.860 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-12-20T04:57:25.883 INFO:teuthology.orchestra.console.smithi183:Power off completed
2023-12-20T04:57:25.894 INFO:teuthology.orchestra.console.smithi076:Power off completed
2023-12-20T04:57:26.014 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com
2023-12-20T04:57:26.030 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com
2023-12-20T04:57:26.037 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com