2023-06-28T16:55:30.129 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T16:55:30.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T16:55:30.131 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T16:55:52.904 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff358a0c520>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff3583a6430>, signals=[15])
2023-06-28T16:55:52.905 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging
2023-06-28T16:55:52.906 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T16:55:52.906 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2023-06-28T16:55:52.931 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-06-28T16:55:52.932 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T16:55:52.932 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-06-28T16:55:52.934 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /host {"name": "smithi005"}
2023-06-28T16:56:02.961 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2023-06-28T16:56:02.962 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T16:56:02.962 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-06-28T16:56:02.963 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-06-28T16:56:17.979 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"}
2023-06-28T16:56:24.249 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T16:56:29.260 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T16:56:39.291 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T16:56:44.298 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T16:56:44.298 DEBUG:teuthology.provision.fog.smithi005:FOG request: PUT /host/111 {"imageID": 3}
2023-06-28T16:56:44.299 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T16:56:44.299 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 3}
2023-06-28T16:56:54.350 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T16:56:54.351 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 3}
2023-06-28T16:56:59.357 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream
2023-06-28T16:56:59.358 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T16:56:59.359 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream
2023-06-28T16:56:59.359 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None
2023-06-28T16:57:09.420 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream
2023-06-28T16:57:09.420 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-06-28T16:57:10.632 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T16:57:10.634 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T16:57:10.685 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-06-28T16:57:10.688 DEBUG:teuthology.provision.fog.smithi005:FOG request: POST /host/111/task {"taskTypeID": 1}
2023-06-28T16:57:10.714 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T16:57:10.741 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None
2023-06-28T16:57:10.750 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T16:57:15.763 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1}
2023-06-28T16:57:22.945 INFO:teuthology.orchestra.console:Power off smithi005
2023-06-28T16:57:22.946 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:57:23.060 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-06-28T16:57:31.003 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:31.041 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-28T16:57:31.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:57:36.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:36.122 INFO:teuthology.orchestra.console:Power off smithi131
2023-06-28T16:57:36.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T16:57:36.190 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2023-06-28T16:57:36.292 INFO:teuthology.orchestra.console:Power on smithi005
2023-06-28T16:57:36.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T16:57:41.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:41.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:41.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:45.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:46.160 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:46.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:50.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:51.273 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:51.327 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:51.539 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-28T16:57:51.640 INFO:teuthology.orchestra.console:Power on smithi107
2023-06-28T16:57:51.640 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T16:57:51.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:55.363 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:55.685 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:57:56.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:00.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:00.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:01.497 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:05.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:05.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:06.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:10.701 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:11.020 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:11.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:15.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:16.130 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:16.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:20.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:21.240 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:21.450 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2023-06-28T16:58:21.552 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2023-06-28T16:58:21.552 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-28T16:58:26.498 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:26.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:58:26.611 INFO:teuthology.orchestra.console:Power on for smithi005 completed
2023-06-28T16:58:26.711 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish
2023-06-28T16:58:26.712 DEBUG:teuthology.provision.fog.smithi005:FOG request: GET /task/active None
2023-06-28T16:58:26.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:58:27.093 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2023-06-28T16:58:27.194 INFO:teuthology.orchestra.console:Power on smithi131
2023-06-28T16:58:27.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T16:58:32.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:37.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:42.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:44.976 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T16:58:45.232 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-28T16:58:47.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T16:58:47.662 INFO:teuthology.orchestra.console:Power on for smithi131 completed
2023-06-28T16:58:47.763 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2023-06-28T16:58:47.763 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-06-28T16:58:47.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:58:50.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:58:51.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:58:54.032 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T16:58:54.292 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-28T16:59:00.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:05.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:10.045 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T16:59:10.046 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-06-28T16:59:16.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:16.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:19.120 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-06-28T16:59:25.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:28.176 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-06-28T16:59:34.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:39.185 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T16:59:42.256 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-06-28T16:59:45.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:48.244 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-28T16:59:48.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:54.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T16:59:54.787 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T16:59:54.789 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T16:59:55.098 INFO:teuthology.provision.fog.smithi107:Node is ready
2023-06-28T16:59:55.098 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2023-06-28T16:59:55.112 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2023-06-28T16:59:55.112 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2023-06-28T16:59:55.163 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2023-06-28T16:59:55.164 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-06-28T16:59:55.320 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2023-06-28T16:59:55.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2023-06-28T16:59:55.407 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2023-06-28T16:59:55.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-06-28T16:59:55.538 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2023-06-28T16:59:55.591 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux"
2023-06-28T16:59:55.591 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.4 (Ootpa)"
2023-06-28T16:59:55.591 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel"
2023-06-28T16:59:55.592 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora"
2023-06-28T16:59:55.592 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.4"
2023-06-28T16:59:55.592 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2023-06-28T16:59:55.593 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-06-28T16:59:55.593 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2023-06-28T16:59:55.593 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-06-28T16:59:55.593 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/"
2023-06-28T16:59:55.594 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-28T16:59:55.594 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-28T16:59:55.594 INFO:teuthology.orchestra.run.smithi107.stdout:
2023-06-28T16:59:55.594 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-28T16:59:55.594 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-06-28T16:59:55.595 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-28T16:59:55.595 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-06-28T16:59:55.599 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi107's OS to be centos 8 but found rhel 8.4
2023-06-28T16:59:55.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T16:59:55.600 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T17:00:00.700 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T17:00:00.821 DEBUG:teuthology.nuke:shortname: smithi005
2023-06-28T17:00:00.821 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T17:00:00.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 16:55:29.318169', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ2tFHJ8lWGr8LrsL1XDC5/as3v5KYedAGy6co1ngXHIx69QbuiFQ1Fsn406MjmBGXQDhTUy7bdhU+H7MOfHUEc='}
2023-06-28T17:00:00.852 DEBUG:teuthology.nuke:shortname: smithi107
2023-06-28T17:00:00.852 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T17:00:00.874 DEBUG:teuthology.nuke:shortname: smithi131
2023-06-28T17:00:00.874 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T17:00:00.878 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 16:55:29.316893', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgAu29s1bDF4fFAh30SrQ9l9rNYjxjKrqXVxnxPn3wtRCqjzEFWS7pO6XU9uu6LJcJHCipqJFsrLV/o6mzD5k6fz5XkHrYAYZ7Pd2dHpv074L4BQnKhX9GBXpyFB/OTqcx68ykNHVdAEHo4lI+zHekSqMSctRKTcHFOGKYQs6S9u4HhBSloAbhCAcA0BENiPTLwxb6tRVro1/0ifq0I62EUkOKh5GCFgbHc0AYnjEWTJTWeItASa3BcEs0M2mH9V06lp5OscYCKpu9GCpaWEOJGS8v0PzGgYiu+Nlc/lHtwwQs/A4bnxkT5VRKeOGtI6/EEzVA+ui+N6RGVEFoZl8vPQ1vRIe6l7fekMEZTgSvNBrGk1J+kuWSOVvl4nITZQAQ0AIDsg8B3nz5xC14lWhp+ftPQAFxCZPSgxT1bcLftyoknjp8xfVGUj7YHPb6A125OAVFz4OwhGyv0D1j6OZF+bNZ7luFa21vQLKdcMMAheWocX2z1VLSQmgED7au4SM='}
2023-06-28T17:00:00.908 INFO:teuthology.orchestra.console:Power off smithi005
2023-06-28T17:00:00.909 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T17:00:00.919 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_14:13:04-rados-quincy_release-distro-default-smithi/7320445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 16:55:29.314677', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/1cnmZYB5UrTdo2X9L455i/eNTgJleQlr1WqP23eDKNDvROXu1GWf/918TEUrMYTVa2nQWe06ghgSR//ZxWeGjhM/b0mt1pk1hc/mFvl640PII62PMcpO4zBo73cwamFw1CafZrNid6/MdgxaZvA+d6h4Y0gK5iFUmQomkauizCDfO//6jMBk4OI1eGDnf5yKvxHSvWIZ4w7rmVCxC3QPbK4WWNhARFk7lD6L50LJiDQAudS0ojlogFbAHOUWCCvh0iSqKr8FfFFYHxIriE8+LMF0eK5J5mk0A/BQ+kLQ1ackis5xypkUEvItGTVAFcsT5vKaQdGGo5BURQcvnfx0K+zSK1zTRRVPt7npeYNtZ+Qd33/icAG8UZWB6+pJEldETaqyvznUmWrGQk/DxX6A0OTgnXr8XLEfBVMt/01xJ163Nj+af3ml5Vbkz32bn3yVBmnGtPaXVEnoCfMncpg8QJNAcklqyzYYBq6Fl2dW5FYa15eixZGMu95ztBk4nts='}
2023-06-28T17:00:00.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:00.952 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-28T17:00:00.952 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T17:00:00.976 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:00.991 INFO:teuthology.orchestra.console:Power off smithi131
2023-06-28T17:00:00.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T17:00:01.014 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:04.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:05.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:05.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:09.080 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:09.115 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:09.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:10.047 WARNING:teuthology.provision.fog.smithi005:timed out
2023-06-28T17:00:14.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:14.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:14.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T17:00:14.478 INFO:teuthology.orchestra.console:Power off for smithi131 completed
2023-06-28T17:00:19.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T17:00:24.617 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2023-06-28T17:00:24.617 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-28T17:00:24.646 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2023-06-28T17:00:38.698 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-28T17:00:38.725 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2023-06-28T17:00:38.734 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com
2023-06-28T17:00:48.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T17:00:53.752 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-28T17:00:53.753 WARNING:teuthology.provision.fog.smithi131:timed out
2023-06-28T17:00:53.935 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi107's OS to be centos 8 but found rhel 8.4