2023-12-20T16:16:20.715 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-20T16:16:20.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T16:16:20.900 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9bbea065b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9bbf95d940>, signals=[15])
2023-12-20T16:16:20.901 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2023-12-20T16:16:20.901 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T16:16:20.901 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-12-20T16:16:20.925 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging
2023-12-20T16:16:20.925 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T16:16:20.925 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server
2023-12-20T16:16:20.949 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2023-12-20T16:16:20.949 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T16:16:20.950 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2023-12-20T16:16:21.049 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T16:16:21.077 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T16:16:21.095 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.6
2023-12-20T16:16:21.104 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T16:16:21.128 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.6
2023-12-20T16:16:21.148 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6
2023-12-20T16:16:21.483 INFO:teuthology.orchestra.console.smithi067:Power off
2023-12-20T16:16:21.483 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T16:16:21.499 INFO:teuthology.orchestra.console.smithi167:Power off
2023-12-20T16:16:21.499 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T16:16:21.513 INFO:teuthology.orchestra.console.smithi072:Power off
2023-12-20T16:16:21.514 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T16:16:21.521 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2023-12-20T16:16:21.521 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:21.529 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off
2023-12-20T16:16:21.529 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:21.539 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2023-12-20T16:16:21.539 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:21.547 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-12-20T16:16:21.555 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2023-12-20T16:16:21.562 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2023-12-20T16:16:21.649 INFO:teuthology.orchestra.console.smithi167:Power off completed
2023-12-20T16:16:21.749 INFO:teuthology.orchestra.console.smithi167:Power on
2023-12-20T16:16:21.750 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T16:16:21.780 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On
2023-12-20T16:16:21.781 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:21.804 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-12-20T16:16:25.557 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:25.568 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:25.670 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2023-12-20T16:16:25.676 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2023-12-20T16:16:25.805 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:25.915 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-12-20T16:16:29.673 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:29.682 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:29.785 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2023-12-20T16:16:29.793 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2023-12-20T16:16:29.887 INFO:teuthology.orchestra.console.smithi067:Power off completed
2023-12-20T16:16:29.916 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:29.988 INFO:teuthology.orchestra.console.smithi067:Power on
2023-12-20T16:16:29.988 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T16:16:30.011 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On
2023-12-20T16:16:30.011 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:30.026 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-12-20T16:16:30.035 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2023-12-20T16:16:30.127 INFO:teuthology.orchestra.console.smithi167:Power on completed
2023-12-20T16:16:30.227 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2023-12-20T16:16:33.797 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:33.908 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2023-12-20T16:16:34.008 INFO:teuthology.orchestra.console.smithi072:Power off completed
2023-12-20T16:16:34.036 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:34.109 INFO:teuthology.orchestra.console.smithi072:Power on
2023-12-20T16:16:34.110 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T16:16:34.135 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On
2023-12-20T16:16:34.135 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:34.145 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2023-12-20T16:16:34.159 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2023-12-20T16:16:38.150 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:38.160 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:16:38.260 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2023-12-20T16:16:38.270 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2023-12-20T16:16:38.361 INFO:teuthology.orchestra.console.smithi067:Power on completed
2023-12-20T16:16:38.371 INFO:teuthology.orchestra.console.smithi072:Power on completed
2023-12-20T16:16:38.462 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2023-12-20T16:16:38.472 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish
2023-12-20T16:18:45.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:18:49.042 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:18:55.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:18:58.097 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:19:04.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:07.153 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:19:13.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:16.209 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:19:22.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:24.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:25.269 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:19:27.381 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-12-20T16:19:31.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:33.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:34.357 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:19:36.465 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-12-20T16:19:40.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:42.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:43.441 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:19:45.521 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-12-20T16:19:49.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:51.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:54.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:19:54.577 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-12-20T16:19:57.525 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-12-20T16:20:00.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:03.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:03.633 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-12-20T16:20:06.609 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-12-20T16:20:07.825 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:20:09.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:12.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:12.689 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-12-20T16:20:13.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:15.665 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-12-20T16:20:16.885 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:20:18.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:21.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:22.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:23.010 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T16:20:24.721 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-12-20T16:20:27.133 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T16:20:30.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:33.777 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-12-20T16:20:34.215 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T16:20:39.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:42.833 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72
2023-12-20T16:20:44.296 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T16:20:48.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:20:57.417 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T16:21:13.501 ERROR:teuthology.orchestra.connection:Error authenticating with smithi167.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-12-20T16:21:18.695 WARNING:teuthology.provision.fog.smithi067:timed out
2023-12-20T16:21:24.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:21:24.930 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T16:21:24.931 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T16:21:25.187 INFO:teuthology.provision.fog.smithi067:Node is ready
2023-12-20T16:21:25.187 DEBUG:teuthology.orchestra.run.smithi067:> hostname
2023-12-20T16:21:25.206 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com
2023-12-20T16:21:25.206 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts
2023-12-20T16:21:25.266 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067
2023-12-20T16:21:25.266 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-12-20T16:21:25.399 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts
2023-12-20T16:21:25.429 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts
2023-12-20T16:21:25.498 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname
2023-12-20T16:21:25.571 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067
2023-12-20T16:21:25.639 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:ID="rhel"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="fedora"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8.6"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T16:21:25.697 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T16:21:25.698 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T16:21:25.699 INFO:teuthology.provision.fog.smithi067:Deploy complete!
2023-12-20T16:21:25.700 DEBUG:teuthology.parallel:result is None
2023-12-20T16:21:48.838 WARNING:teuthology.provision.fog.smithi072:timed out
2023-12-20T16:21:50.994 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:21:54.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:21:55.099 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T16:21:55.099 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T16:21:55.369 INFO:teuthology.provision.fog.smithi072:Node is ready
2023-12-20T16:21:55.369 DEBUG:teuthology.orchestra.run.smithi072:> hostname
2023-12-20T16:21:55.388 INFO:teuthology.orchestra.run.smithi072.stdout:smithi045
2023-12-20T16:21:55.388 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi045 /etc/hosts
2023-12-20T16:21:55.446 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-12-20T16:21:55.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi045/smithi072/g' /etc/hostname
2023-12-20T16:21:55.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072
2023-12-20T16:21:55.592 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel"
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora"
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6"
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8"
2023-12-20T16:21:55.649 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T16:21:55.650 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T16:21:55.650 INFO:teuthology.provision.fog.smithi072:Deploy complete!
2023-12-20T16:21:55.651 DEBUG:teuthology.parallel:result is None
2023-12-20T16:21:56.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:22:00.053 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:22:06.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:22:09.105 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:22:15.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:22:18.162 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:22:24.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:22:42.706 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:22:48.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:22:51.765 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2023-12-20T16:22:57.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T16:22:59.764 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T16:22:59.764 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T16:23:25.764 INFO:teuthology.provision.fog.smithi167:Node is ready
2023-12-20T16:23:25.764 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2023-12-20T16:23:25.789 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2023-12-20T16:23:25.789 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts
2023-12-20T16:23:25.850 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2023-12-20T16:23:25.850 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-12-20T16:23:25.978 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts
2023-12-20T16:23:26.009 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2023-12-20T16:23:26.080 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname
2023-12-20T16:23:26.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2023-12-20T16:23:26.195 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2023-12-20T16:23:26.254 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-20T16:23:26.255 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/"
2023-12-20T16:23:26.255 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T16:23:26.255 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T16:23:26.255 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-20T16:23:26.257 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi167's OS to be rhel 8.6 but found centos 8
2023-12-20T16:23:26.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T16:23:26.411 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f8fefa1664544230add18a10d0054f2c
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi167's OS to be rhel 8.6 but found centos 8
2023-12-20T16:23:26.414 INFO:teuthology.nuke:Checking targets against current locks
2023-12-20T16:23:26.495 DEBUG:teuthology.nuke:shortname: smithi067
2023-12-20T16:23:26.496 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T16:23:26.518 DEBUG:teuthology.nuke:shortname: smithi072
2023-12-20T16:23:26.519 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T16:23:26.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497990', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 16:16:19.833718', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFoKAx+ewks9KP4pzf45WGXiZIZ3F1Ad9quLCsw5x9YEbpqVieXiuD3N5FVq+HCtBuZiFYUYMhigF0/QOd2hKpw='}
2023-12-20T16:23:26.540 DEBUG:teuthology.nuke:shortname: smithi167
2023-12-20T16:23:26.540 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T16:23:26.545 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497990', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 16:16:19.832012', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObgCJMy9XkqQwweSaXwazBbAlEFANxTTuVHqCyckkAy9PbuOptFME1rss6taUZ1sCmmXfiQAb3gehyQ5Qu7AWI='}
2023-12-20T16:23:26.570 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497995', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 16:18:31.956936', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJF0ZG/4vYDQuwSSjDq3o0VX5+PDPcA88vCbZz2vLk4oLjJqlBSKoGofFqQJUy+JvZalP88MjTF/bkpiHQwQ48='}
2023-12-20T16:23:26.579 INFO:teuthology.orchestra.console.smithi067:Power off
2023-12-20T16:23:26.580 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T16:23:26.604 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off
2023-12-20T16:23:26.605 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:26.623 INFO:teuthology.orchestra.console.smithi072:Power off
2023-12-20T16:23:26.624 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T16:23:26.638 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2023-12-20T16:23:26.648 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off
2023-12-20T16:23:26.649 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:26.670 INFO:teuthology.orchestra.console.smithi167:Power off
2023-12-20T16:23:26.671 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T16:23:26.681 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2023-12-20T16:23:26.694 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2023-12-20T16:23:26.694 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:26.723 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-12-20T16:23:30.639 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:30.682 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:30.725 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:30.750 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on
2023-12-20T16:23:30.795 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on
2023-12-20T16:23:30.835 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-12-20T16:23:34.751 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:34.796 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:34.835 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:34.862 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off
2023-12-20T16:23:34.906 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off
2023-12-20T16:23:34.945 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2023-12-20T16:23:34.963 INFO:teuthology.orchestra.console.smithi067:Power off completed
2023-12-20T16:23:35.007 INFO:teuthology.orchestra.console.smithi072:Power off completed
2023-12-20T16:23:35.121 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2023-12-20T16:23:35.154 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com
2023-12-20T16:23:38.946 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T16:23:39.058 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2023-12-20T16:23:39.159 INFO:teuthology.orchestra.console.smithi167:Power off completed
2023-12-20T16:23:39.303 ERROR:teuthology.lock.ops:failed to unlock smithi167.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node
2023-12-20T16:23:39.670 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi167's OS to be rhel 8.6 but found centos 8