2023-12-20T15:38:28.256 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-20T15:38:28.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T15:38:28.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff255ea4940>, signals=[15]) 2023-12-20T15:38:28.443 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-12-20T15:38:28.443 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-12-20T15:38:28.444 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-12-20T15:38:28.470 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-12-20T15:38:28.470 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-12-20T15:38:28.470 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-12-20T15:38:28.593 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-20T15:38:28.613 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-20T15:38:28.640 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of rhel 8.6 2023-12-20T15:38:28.665 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6 2023-12-20T15:38:28.863 INFO:teuthology.orchestra.console.smithi049:Power off 2023-12-20T15:38:28.863 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T15:38:28.894 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-20T15:38:28.895 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T15:38:28.918 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-12-20T15:38:28.918 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:28.937 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-20T15:38:28.937 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:28.952 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-12-20T15:38:28.969 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-20T15:38:29.058 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-12-20T15:38:29.070 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-20T15:38:29.166 INFO:teuthology.orchestra.console.smithi049:Power on 2023-12-20T15:38:29.167 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-20T15:38:29.197 INFO:teuthology.orchestra.console.smithi195:Power on 2023-12-20T15:38:29.197 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-20T15:38:29.226 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-12-20T15:38:29.226 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:29.240 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2023-12-20T15:38:29.241 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:29.269 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-12-20T15:38:29.286 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-20T15:38:33.273 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:33.289 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:33.391 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-12-20T15:38:33.408 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-20T15:38:37.395 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:37.417 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:38:37.525 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-20T15:38:37.542 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-20T15:38:37.627 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-12-20T15:38:37.643 INFO:teuthology.orchestra.console.smithi195:Power on completed 2023-12-20T15:38:37.728 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-12-20T15:38:37.745 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-12-20T15:40:38.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:40:41.394 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:40:47.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:40:50.450 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:40:56.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:40:59.505 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:41:05.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:08.565 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:41:14.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:17.653 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:41:23.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:26.738 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:41:32.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:35.797 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:41:41.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:44.881 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:41:50.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:53.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:41:56.721 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:01.234 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:42:02.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:05.809 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:07.237 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:10.289 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:42:11.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:14.866 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:16.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:16.807 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:42:20.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:22.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:22.953 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-20T15:42:23.925 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:27.084 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-20T15:42:29.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:32.977 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:34.185 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-20T15:42:38.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:42.034 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:44.322 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-20T15:42:48.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:51.093 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:42:57.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:42:57.462 ERROR:teuthology.orchestra.connection:Error authenticating with smithi195.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-20T15:43:00.148 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-12-20T15:43:06.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:06.153 WARNING:teuthology.provision.fog.smithi049:timed out 2023-12-20T15:44:12.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:12.423 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-20T15:44:12.423 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-20T15:44:12.710 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-12-20T15:44:12.711 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-12-20T15:44:12.730 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-12-20T15:44:12.730 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-12-20T15:44:12.789 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-12-20T15:44:12.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-12-20T15:44:12.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-12-20T15:44:12.924 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-12-20T15:44:12.994 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-12-20T15:44:13.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-12-20T15:44:13.132 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8.6 (Ootpa)" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:ID="rhel" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="fedora" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8.6" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T15:44:13.190 INFO:teuthology.orchestra.run.smithi049.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T15:44:13.191 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T15:44:13.191 INFO:teuthology.orchestra.run.smithi049.stdout: 2023-12-20T15:44:13.191 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T15:44:13.191 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-20T15:44:13.191 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T15:44:13.191 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-20T15:44:13.191 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-12-20T15:44:13.193 DEBUG:teuthology.parallel:result is None 2023-12-20T15:44:13.465 WARNING:teuthology.provision.fog.smithi195:timed out 2023-12-20T15:44:19.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:22.546 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:44:28.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:31.601 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:44:37.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:40.657 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:44:46.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:49.717 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-12-20T15:44:55.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T15:44:55.926 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-20T15:44:55.926 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-20T15:45:16.238 INFO:teuthology.provision.fog.smithi195:Node is ready 2023-12-20T15:45:16.238 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2023-12-20T15:45:16.257 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2023-12-20T15:45:16.257 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2023-12-20T15:45:16.314 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2023-12-20T15:45:16.315 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-20T15:45:16.440 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2023-12-20T15:45:16.473 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2023-12-20T15:45:16.544 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2023-12-20T15:45:16.612 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2023-12-20T15:45:16.680 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-12-20T15:45:16.737 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2023-12-20T15:45:16.737 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-20T15:45:16.738 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-20T15:45:16.740 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi195's OS to be rhel 8.6 but found centos 9 2023-12-20T15:45:16.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T15:45:16.955 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c1a8fbc01e30437c9070a9c2ae296d88 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi195's OS to be rhel 8.6 but found centos 9 2023-12-20T15:45:16.958 INFO:teuthology.nuke:Checking targets against current locks 2023-12-20T15:45:17.030 DEBUG:teuthology.nuke:shortname: smithi049 2023-12-20T15:45:17.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T15:45:17.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497921', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 15:38:27.163159', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-20T15:45:17.062 DEBUG:teuthology.nuke:shortname: smithi195 2023-12-20T15:45:17.062 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T15:45:17.090 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_15:22:54-rados-wip-yuri-testing-2023-12-19-1112-distro-default-smithi/7497922', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 15:40:27.881410', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEjvCM3uz9dm8vsg/03hReaPaQ2481R9NN1g+Lb3BrbBCdoLPeL7Gg+uuyHQtEJTXnQDnUK7rZR2PjI0KEFGERU='} 2023-12-20T15:45:17.169 INFO:teuthology.orchestra.console.smithi049:Power off 2023-12-20T15:45:17.170 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T15:45:17.271 INFO:teuthology.orchestra.console.smithi195:Power off 2023-12-20T15:45:17.272 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T15:45:17.305 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-12-20T15:45:17.306 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:17.353 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2023-12-20T15:45:17.354 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:17.383 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-20T15:45:17.425 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-20T15:45:21.383 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:21.426 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:21.506 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-12-20T15:45:21.554 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-20T15:45:25.506 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:25.555 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:25.634 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-12-20T15:45:25.689 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2023-12-20T15:45:25.735 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-12-20T15:45:25.893 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-12-20T15:45:29.693 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T15:45:29.814 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2023-12-20T15:45:29.915 INFO:teuthology.orchestra.console.smithi195:Power off completed 2023-12-20T15:45:30.069 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com 2023-12-20T15:45:30.373 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/dispatcher/supervisor.py", line 232, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/provision/fog.py", line 347, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi195's OS to be rhel 8.6 but found centos 9