2024-04-10T17:50:02.051 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-10T17:50:02.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T17:50:02.257 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f509f7c9f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f50a0829c10>, signals=[15])
2024-04-10T17:50:02.257 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2024-04-10T17:50:02.257 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:50:02.258 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-04-10T17:50:02.274 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2024-04-10T17:50:02.274 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:50:02.275 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2024-04-10T17:50:02.299 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2024-04-10T17:50:02.299 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:50:02.299 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2024-04-10T17:50:02.324 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging
2024-04-10T17:50:02.324 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server
2024-04-10T17:50:02.324 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2024-04-10T17:50:02.390 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T17:50:02.407 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T17:50:02.432 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream
2024-04-10T17:50:02.438 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T17:50:02.443 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream
2024-04-10T17:50:02.457 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10)
2024-04-10T17:50:02.495 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream
2024-04-10T17:50:02.495 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream
2024-04-10T17:50:02.731 INFO:teuthology.orchestra.console.smithi017:Power off
2024-04-10T17:50:02.732 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:50:02.751 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-04-10T17:50:02.751 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:02.770 INFO:teuthology.orchestra.console.smithi151:Power off
2024-04-10T17:50:02.770 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:50:02.784 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-10T17:50:02.784 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:50:02.793 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-10T17:50:02.795 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2024-04-10T17:50:02.795 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:02.810 INFO:teuthology.orchestra.console.smithi163:Power off
2024-04-10T17:50:02.810 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:50:02.819 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-04-10T17:50:02.819 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-10T17:50:02.820 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:02.833 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-04-10T17:50:02.834 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:02.842 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:50:02.854 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-10T17:50:02.894 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-04-10T17:50:02.920 INFO:teuthology.orchestra.console.smithi151:Power off completed
2024-04-10T17:50:02.944 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-10T17:50:02.954 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-04-10T17:50:02.995 INFO:teuthology.orchestra.console.smithi017:Power on
2024-04-10T17:50:02.995 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:50:03.018 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2024-04-10T17:50:03.018 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:03.026 INFO:teuthology.orchestra.console.smithi151:Power on
2024-04-10T17:50:03.026 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:50:03.040 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-10T17:50:03.045 INFO:teuthology.orchestra.console.smithi027:Power on
2024-04-10T17:50:03.045 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:50:03.052 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2024-04-10T17:50:03.052 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:03.059 INFO:teuthology.orchestra.console.smithi163:Power on
2024-04-10T17:50:03.060 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-10T17:50:03.069 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2024-04-10T17:50:03.069 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:03.079 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-04-10T17:50:03.081 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On
2024-04-10T17:50:03.081 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:03.092 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:50:03.100 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-10T17:50:07.042 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:07.080 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:07.093 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:07.101 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:07.152 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-10T17:50:07.189 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2024-04-10T17:50:07.202 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:50:07.209 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-04-10T17:50:07.310 INFO:teuthology.orchestra.console.smithi163:Power on completed
2024-04-10T17:50:07.410 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2024-04-10T17:50:11.157 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:11.190 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:11.203 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:50:11.266 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-10T17:50:11.299 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2024-04-10T17:50:11.310 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-10T17:50:11.368 INFO:teuthology.orchestra.console.smithi017:Power on completed
2024-04-10T17:50:11.399 INFO:teuthology.orchestra.console.smithi151:Power on completed
2024-04-10T17:50:11.411 INFO:teuthology.orchestra.console.smithi027:Power on completed
2024-04-10T17:50:11.469 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2024-04-10T17:50:11.500 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2024-04-10T17:50:11.512 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2024-04-10T17:50:11.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:50:14.718 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:50:20.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:50:23.806 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:50:29.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:50:32.862 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:50:38.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:50:41.918 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:50:47.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:50:51.006 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:50:57.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:00.062 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:51:06.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:09.150 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:51:15.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:18.206 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:51:24.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:27.262 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:51:33.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:39.390 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:51:45.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:48.446 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:51:54.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:51:56.710 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:52:02.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:52:02.850 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:52:06.981 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:52:14.115 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:52:24.245 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:52:37.375 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:52:43.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:52:46.526 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-10T17:52:52.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:52:53.462 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:52:55.582 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-10T17:53:01.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:53:04.638 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-10T17:53:10.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:53:12.592 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:53:13.694 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-10T17:53:19.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:53:22.750 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-10T17:53:28.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:53:34.722 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:53:59.856 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:54:27.988 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:54:27.988 WARNING:teuthology.provision.fog.smithi151:'connect to smithi151.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2024-04-10T17:54:28.754 WARNING:teuthology.provision.fog.smithi017:timed out
2024-04-10T17:54:33.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:54:34.120 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:54:34.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:54:35.012 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T17:54:35.012 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T17:54:35.384 INFO:teuthology.provision.fog.smithi017:Node is ready
2024-04-10T17:54:35.385 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2024-04-10T17:54:35.399 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2024-04-10T17:54:35.400 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2024-04-10T17:54:35.455 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2024-04-10T17:54:35.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-10T17:54:35.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2024-04-10T17:54:35.595 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2024-04-10T17:54:35.665 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2024-04-10T17:54:35.736 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-10T17:54:35.806 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-04-10T17:54:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-04-10T17:54:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2024-04-10T17:54:35.860 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T17:54:35.861 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T17:54:35.862 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2024-04-10T17:54:35.863 DEBUG:teuthology.parallel:result is None
2024-04-10T17:54:38.211 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:54:45.342 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:54:55.471 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:54:55.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:54:59.006 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:05.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:55:08.062 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:08.563 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:55:14.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:55:17.118 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:23.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:55:24.653 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:55:26.174 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:32.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:55:35.230 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:41.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:55:43.746 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:55:44.286 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:50.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:55:53.343 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:55:59.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:02.398 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:56:05.874 ERROR:teuthology.orchestra.connection:Error authenticating with smithi151.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-10T17:56:08.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:11.454 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163
2024-04-10T17:56:15.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:17.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:18.334 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:56:24.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:27.394 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:56:33.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:36.446 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:56:42.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:45.502 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:56:49.310 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:56:51.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:54.558 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:56:55.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:56:58.366 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:57:00.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:03.614 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:57:04.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:07.422 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:57:09.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:12.670 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:57:13.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:16.478 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:57:17.459 WARNING:teuthology.provision.fog.smithi163:timed out
2024-04-10T17:57:18.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:21.730 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:57:22.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:23.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:23.754 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T17:57:23.754 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T17:57:24.083 INFO:teuthology.provision.fog.smithi163:Node is ready
2024-04-10T17:57:24.083 DEBUG:teuthology.orchestra.run.smithi163:> hostname
2024-04-10T17:57:24.098 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2024-04-10T17:57:24.098 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts
2024-04-10T17:57:24.152 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2024-04-10T17:57:24.152 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-04-10T17:57:24.265 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts
2024-04-10T17:57:24.293 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts
2024-04-10T17:57:24.357 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname
2024-04-10T17:57:24.423 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163
2024-04-10T17:57:24.489 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-10T17:57:24.544 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/"
2024-04-10T17:57:24.545 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-10T17:57:24.545 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-10T17:57:24.545 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-10T17:57:24.545 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2024-04-10T17:57:24.546 DEBUG:teuthology.parallel:result is None
2024-04-10T17:57:25.534 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:57:27.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:30.782 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:57:31.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:36.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:39.838 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2024-04-10T17:57:45.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:49.982 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:57:55.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:57:59.038 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:58:05.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:08.094 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:58:14.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:14.098 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:58:20.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:20.101 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:58:26.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:26.105 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:58:32.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:32.108 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2024-04-10T17:58:38.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:38.393 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-10T17:58:38.393 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-10T17:58:38.841 INFO:teuthology.provision.fog.smithi151:Node is ready
2024-04-10T17:58:38.841 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2024-04-10T17:58:38.894 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2024-04-10T17:58:38.894 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2024-04-10T17:58:38.943 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2024-04-10T17:58:38.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-04-10T17:58:39.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2024-04-10T17:58:39.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2024-04-10T17:58:39.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2024-04-10T17:58:39.178 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2024-04-10T17:58:39.236 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2024-04-10T17:58:39.281 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Ubuntu"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="22.04"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_CODENAME=jammy
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:ID=ubuntu
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE=debian
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.ubuntu.com/"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-04-10T17:58:39.282 INFO:teuthology.orchestra.run.smithi151.stdout:UBUNTU_CODENAME=jammy
2024-04-10T17:58:39.284 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi151's OS to be centos 9 but found ubuntu 22.04
2024-04-10T17:58:39.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-10T17:58:39.590 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3d0c8045ce834746af8a9c8ec5cc4a00
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi151's OS to be centos 9 but found ubuntu 22.04
2024-04-10T17:58:39.592 INFO:teuthology.nuke:Checking targets against current locks
2024-04-10T17:58:39.658 DEBUG:teuthology.nuke:shortname: smithi017
2024-04-10T17:58:39.659 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-10T17:58:39.678 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7650888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-10 17:50:00.932940', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE0pVNuDApJZQgc5Hu17wdbsHBtr27tnwllHUoS3NZm3'}
2024-04-10T17:58:39.682 DEBUG:teuthology.nuke:shortname: smithi027
2024-04-10T17:58:39.682 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-10T17:58:39.683 INFO:teuthology.nuke:Not nuking smithi151.front.sepia.ceph.com because description doesn't match: yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi != /home/teuthworker/archive/yuriw-2024-04-10_14:17:51-rados-wip-yuri6-testing-2024-04-02-1310-distro-default-smithi/7650889
2024-04-10T17:58:39.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7650888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-10 17:50:00.937779', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBjxqZpSJLKNOQ8go1bf9H7gnI6uGFYfNjEGXPBRacVx'}
2024-04-10T17:58:39.732 DEBUG:teuthology.nuke:shortname: smithi163
2024-04-10T17:58:39.733 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-10T17:58:39.738 INFO:teuthology.orchestra.console.smithi017:Power off
2024-04-10T17:58:39.739 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:58:39.762 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-04-10T17:58:39.762 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:39.775 INFO:teuthology.orchestra.console.smithi027:Power off
2024-04-10T17:58:39.775 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:58:39.785 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7650888', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-10 17:50:00.935449', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILz0BSlio60U+UF+sE8wmDLzNuy9zK+UA5O8cE0DAE4N'}
2024-04-10T17:58:39.789 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-10T17:58:39.799 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2024-04-10T17:58:39.799 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:39.821 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-10T17:58:39.833 INFO:teuthology.orchestra.console.smithi163:Power off
2024-04-10T17:58:39.834 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-10T17:58:39.856 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off
2024-04-10T17:58:39.856 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:39.882 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-04-10T17:58:43.790 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:43.822 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:43.883 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:43.903 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-10T17:58:43.933 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-10T17:58:43.995 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on
2024-04-10T17:58:45.842 WARNING:teuthology.provision.fog.smithi027:timed out
2024-04-10T17:58:47.904 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:47.935 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:47.995 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:48.014 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-10T17:58:48.044 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2024-04-10T17:58:48.105 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off
2024-04-10T17:58:48.115 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-04-10T17:58:48.207 INFO:teuthology.orchestra.console.smithi163:Power off completed
2024-04-10T17:58:48.269 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2024-04-10T17:58:48.369 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com
2024-04-10T17:58:51.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-10T17:58:52.044 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-10T17:58:52.153 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2024-04-10T17:58:52.255 INFO:teuthology.orchestra.console.smithi027:Power off completed
2024-04-10T17:58:52.402 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2024-04-10T17:58:52.404 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi151.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKXQyK9/kY/eKcYWc94m4R4JLf4+yP4sMnxSqLtraqnP
2024-04-10T17:58:52.899 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi151's OS to be centos 9 but found ubuntu 22.04