2024-04-13T18:53:21.608 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-13T18:53:21.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T18:53:21.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1d9c37bf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1d9d3dcc10>, signals=[15])
2024-04-13T18:53:21.814 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-04-13T18:53:21.814 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:21.815 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-04-13T18:53:21.838 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2024-04-13T18:53:21.839 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:21.839 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2024-04-13T18:53:21.863 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-04-13T18:53:21.863 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:21.863 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-04-13T18:53:21.882 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging
2024-04-13T18:53:21.882 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server
2024-04-13T18:53:21.882 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server
2024-04-13T18:53:21.950 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T18:53:21.958 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T18:53:21.986 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T18:53:21.989 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 8.stream
2024-04-13T18:53:22.002 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream
2024-04-13T18:53:22.010 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_8.stream (ID 3)
2024-04-13T18:53:22.042 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream
2024-04-13T18:53:22.047 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 8.stream
2024-04-13T18:53:22.126 DEBUG:teuthology.provision.fog.smithi112:Canceling deploy task with ID 953872
2024-04-13T18:53:22.186 DEBUG:teuthology.provision.fog.smithi142:Canceling deploy task with ID 953874
2024-04-13T18:53:22.187 DEBUG:teuthology.provision.fog.smithi175:Canceling deploy task with ID 953873
2024-04-13T18:53:22.455 INFO:teuthology.orchestra.console.smithi131:Power off
2024-04-13T18:53:22.456 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:22.478 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:22.478 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.501 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-04-13T18:53:22.524 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-13T18:53:22.524 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:22.544 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:22.544 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.557 INFO:teuthology.orchestra.console.smithi142:Power off
2024-04-13T18:53:22.557 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:22.566 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T18:53:22.581 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:22.581 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.600 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-13T18:53:22.600 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T18:53:22.608 INFO:teuthology.orchestra.console.smithi131:Power off completed
2024-04-13T18:53:22.610 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T18:53:22.622 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-13T18:53:22.622 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.647 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T18:53:22.667 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-13T18:53:22.709 INFO:teuthology.orchestra.console.smithi131:Power on
2024-04-13T18:53:22.710 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:22.718 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-04-13T18:53:22.731 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:22.731 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.749 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-13T18:53:22.751 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-04-13T18:53:22.768 INFO:teuthology.orchestra.console.smithi112:Power on
2024-04-13T18:53:22.769 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:22.793 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:22.793 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.817 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T18:53:22.819 INFO:teuthology.orchestra.console.smithi142:Power on
2024-04-13T18:53:22.819 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:22.845 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:22.845 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.854 INFO:teuthology.orchestra.console.smithi175:Power on
2024-04-13T18:53:22.854 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-13T18:53:22.870 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T18:53:22.874 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On
2024-04-13T18:53:22.874 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:22.899 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T18:53:26.754 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:26.818 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:26.863 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-04-13T18:53:26.872 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:26.900 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:26.927 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T18:53:26.981 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T18:53:27.011 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T18:53:30.867 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:30.928 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:30.976 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-04-13T18:53:30.982 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:31.012 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T18:53:31.037 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-13T18:53:31.076 INFO:teuthology.orchestra.console.smithi131:Power on completed
2024-04-13T18:53:31.090 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-13T18:53:31.121 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-13T18:53:31.138 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-04-13T18:53:31.178 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2024-04-13T18:53:31.191 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-04-13T18:53:31.222 INFO:teuthology.orchestra.console.smithi175:Power on completed
2024-04-13T18:53:31.239 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-04-13T18:53:31.292 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-04-13T18:53:31.323 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish
2024-04-13T18:57:03.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:03.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:19.870 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T18:57:21.022 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T18:57:25.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:25.886 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T18:57:27.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:30.078 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T18:57:31.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:33.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:33.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:34.942 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T18:57:36.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:36.830 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-13T18:57:37.822 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:57:39.138 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T18:57:40.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:42.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:43.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:44.002 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T18:57:45.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:45.278 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T18:57:45.890 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-13T18:57:46.878 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:57:50.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:51.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:51.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:52.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:57:53.054 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-04-13T18:57:54.334 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175
2024-04-13T18:57:54.942 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-13T18:57:55.934 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:57:59.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:00.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:00.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:01.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:03.998 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-13T18:58:04.990 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:58:10.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:10.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:13.054 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-13T18:58:14.046 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:58:19.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:20.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:22.110 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2024-04-13T18:58:23.102 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:58:28.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:29.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:58:59.086 WARNING:teuthology.provision.fog.smithi112:timed out
2024-04-13T18:59:00.341 WARNING:teuthology.provision.fog.smithi175:timed out
2024-04-13T18:59:05.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:05.309 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:59:05.310 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:59:05.580 INFO:teuthology.provision.fog.smithi112:Node is ready
2024-04-13T18:59:05.581 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2024-04-13T18:59:05.599 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2024-04-13T18:59:05.600 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2024-04-13T18:59:05.659 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2024-04-13T18:59:05.660 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-04-13T18:59:05.770 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2024-04-13T18:59:05.807 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2024-04-13T18:59:05.875 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2024-04-13T18:59:05.945 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-04-13T18:59:06.011 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-04-13T18:59:06.068 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:59:06.069 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T18:59:06.070 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2024-04-13T18:59:06.072 DEBUG:teuthology.parallel:result is None
2024-04-13T18:59:06.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:06.562 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:59:06.562 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:59:06.835 INFO:teuthology.provision.fog.smithi175:Node is ready
2024-04-13T18:59:06.836 DEBUG:teuthology.orchestra.run.smithi175:> hostname
2024-04-13T18:59:06.855 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com
2024-04-13T18:59:06.855 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts
2024-04-13T18:59:06.917 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175
2024-04-13T18:59:06.917 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-04-13T18:59:07.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts
2024-04-13T18:59:07.051 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts
2024-04-13T18:59:07.120 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname
2024-04-13T18:59:07.189 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175
2024-04-13T18:59:07.256 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31"
2024-04-13T18:59:07.315 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-13T18:59:07.316 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/"
2024-04-13T18:59:07.316 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:59:07.316 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:59:07.316 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T18:59:07.316 INFO:teuthology.provision.fog.smithi175:Deploy complete!
2024-04-13T18:59:07.316 DEBUG:teuthology.parallel:result is None
2024-04-13T18:59:28.138 WARNING:teuthology.provision.fog.smithi131:timed out
2024-04-13T18:59:29.107 WARNING:teuthology.provision.fog.smithi142:timed out
2024-04-13T18:59:34.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:34.384 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T18:59:34.385 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T18:59:34.627 INFO:teuthology.provision.fog.smithi131:Node is ready
2024-04-13T18:59:34.627 DEBUG:teuthology.orchestra.run.smithi131:> hostname
2024-04-13T18:59:34.646 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2024-04-13T18:59:34.647 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts
2024-04-13T18:59:34.707 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2024-04-13T18:59:34.707 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2024-04-13T18:59:34.829 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts
2024-04-13T18:59:34.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts
2024-04-13T18:59:34.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname
2024-04-13T18:59:35.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2024-04-13T18:59:35.069 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2024-04-13T18:59:35.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:35.128 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2024-04-13T18:59:35.128 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8"
2024-04-13T18:59:35.128 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-13T18:59:35.129 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T18:59:35.129 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2024-04-13T18:59:35.130 DEBUG:teuthology.parallel:result is None
2024-04-13T18:59:36.606 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:59:42.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:43.262 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:59:49.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:49.918 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T18:59:55.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T18:59:56.578 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:02.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:03.486 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:09.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:10.142 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:16.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:16.805 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:22.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:23.454 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:29.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:30.110 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:36.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:36.770 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:42.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:00:53.150 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:00:59.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:01:02.206 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:01:08.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:01:08.341 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:01:12.471 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:01:19.559 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:01:29.657 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:01:42.788 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:01:58.917 ERROR:teuthology.orchestra.connection:Error authenticating with smithi142.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-13T19:02:52.447 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-13T19:02:58.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:03:58.451 WARNING:teuthology.provision.fog.smithi142:timed out
2024-04-13T19:04:04.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-13T19:04:04.549 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-13T19:04:04.550 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-13T19:04:04.623 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-04-13T19:04:04.623 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-04-13T19:04:04.679 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142
2024-04-13T19:04:04.679 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142 /etc/hosts
2024-04-13T19:04:04.735 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-04-13T19:04:04.735 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-13T19:04:04.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hosts
2024-04-13T19:04:04.874 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-04-13T19:04:04.943 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142/smithi142/g' /etc/hostname
2024-04-13T19:04:05.011 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-13T19:04:05.078 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon"
2024-04-13T19:04:05.134 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-13T19:04:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/"
2024-04-13T19:04:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-13T19:04:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-13T19:04:05.135 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-13T19:04:05.138 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi142's OS to be centos 8 but found centos 9
2024-04-13T19:04:05.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-13T19:04:05.464 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c2c5ce8792324b5b9db92df0f2cd9532
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi142's OS to be centos 8 but found centos 9
2024-04-13T19:04:05.465 INFO:teuthology.nuke:Checking targets against current locks
2024-04-13T19:04:05.539 DEBUG:teuthology.nuke:shortname: smithi112
2024-04-13T19:04:05.540 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:04:05.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 19:00:24.622525', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBneW4ATl3sTTRxfVvh4ivJAHW/MMa4eXXyAfuBDamCHHMay1sSjFuG2zNXnZ2w0x2ZC/RVEa+ngEan5jxEweXo='}
2024-04-13T19:04:05.569 DEBUG:teuthology.nuke:shortname: smithi131
2024-04-13T19:04:05.569 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:04:05.601 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653248', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 18:53:20.507193', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB8EI5nRfLDa016aNgVecZYm8FXBpUPeD/sXPTA8q+PKaCGPGevmX6HNxRKJyfLLeiayj3+X6y3m+fJE30MCQ9w='}
2024-04-13T19:04:05.602 DEBUG:teuthology.nuke:shortname: smithi142
2024-04-13T19:04:05.602 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:04:05.608 DEBUG:teuthology.nuke:shortname: smithi175
2024-04-13T19:04:05.608 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-13T19:04:05.634 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 19:00:24.623524', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJxuGndVIEDHcnZuY6h2gsf13WKYfnx0X6srHN9oulzB1DDFTGO5yRMiSL2QqUxK+xA6wsmv002CtBJTrlRoCd0='}
2024-04-13T19:04:05.636 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-11_22:32:02-powercycle-reef-distro-default-smithi/7653254', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-13 18:59:24.091534', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAtwlkAjW/aYQUzB7FxfzQFc0uDPOXAhW7t2TPcZB4rjfKAjqRT4jQFwBFSqRLD20Ef5LY3VbIHP+R6u15O/f+w='}
2024-04-13T19:04:05.645 INFO:teuthology.orchestra.console.smithi112:Power off
2024-04-13T19:04:05.645 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:04:05.671 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-04-13T19:04:05.672 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:05.690 INFO:teuthology.orchestra.console.smithi131:Power off
2024-04-13T19:04:05.691 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:04:05.705 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-04-13T19:04:05.717 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2024-04-13T19:04:05.717 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:05.740 INFO:teuthology.orchestra.console.smithi142:Power off
2024-04-13T19:04:05.740 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:04:05.754 INFO:teuthology.orchestra.console.smithi175:Power off
2024-04-13T19:04:05.755 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-13T19:04:05.763 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-04-13T19:04:05.764 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:05.772 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-04-13T19:04:05.799 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-13T19:04:06.003 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off
2024-04-13T19:04:06.004 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:06.028 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on
2024-04-13T19:04:09.706 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:09.773 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:09.800 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:09.816 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-04-13T19:04:09.885 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-04-13T19:04:09.911 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-13T19:04:09.917 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-04-13T19:04:10.029 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:10.062 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2024-04-13T19:04:10.139 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off
2024-04-13T19:04:10.240 INFO:teuthology.orchestra.console.smithi175:Power off completed
2024-04-13T19:04:10.396 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com
2024-04-13T19:04:13.885 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:13.912 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:13.996 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2024-04-13T19:04:14.022 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-13T19:04:17.996 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:18.023 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-13T19:04:18.106 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2024-04-13T19:04:18.134 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-13T19:04:18.207 INFO:teuthology.orchestra.console.smithi131:Power off completed
2024-04-13T19:04:18.235 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-04-13T19:04:18.360 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2024-04-13T19:04:18.377 INFO:teuthology.lock.ops:unlocked: smithi142.front.sepia.ceph.com
2024-04-13T19:04:18.881 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi142's OS to be centos 8 but found centos 9