2023-07-11T08:23:05.055 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T08:23:05.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T08:23:05.057 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T08:23:05.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa0f5068550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa0f49bf700>, signals=[15])
2023-07-11T08:23:05.298 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging
2023-07-11T08:23:05.299 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T08:23:05.299 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2023-07-11T08:23:05.323 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-07-11T08:23:05.324 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T08:23:05.324 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-07-11T08:23:05.325 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /host {"name": "smithi037"}
2023-07-11T08:23:08.631 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging
2023-07-11T08:23:08.632 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T08:23:08.632 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-07-11T08:23:08.633 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-07-11T08:23:18.656 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"}
2023-07-11T08:23:18.662 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T08:23:18.710 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T08:23:18.710 DEBUG:teuthology.provision.fog.smithi037:FOG request: PUT /host/142 {"imageID": 3}
2023-07-11T08:23:18.717 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T08:23:18.726 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T08:23:18.782 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T08:23:18.783 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3}
2023-07-11T08:23:18.786 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T08:23:18.786 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 3}
2023-07-11T08:23:18.812 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream
2023-07-11T08:23:18.812 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-11T08:23:18.844 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2023-07-11T08:23:18.845 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T08:23:18.915 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 8.stream
2023-07-11T08:23:18.915 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-11T08:23:18.957 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T08:23:19.024 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T08:23:19.060 DEBUG:teuthology.provision.fog.smithi037:FOG request: POST /host/142/task {"taskTypeID": 1}
2023-07-11T08:23:19.081 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-07-11T08:23:19.194 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-11T08:23:19.223 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T08:23:19.244 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T08:23:19.297 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1}
2023-07-11T08:23:19.405 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-11T08:23:19.432 INFO:teuthology.orchestra.console:Power off smithi037
2023-07-11T08:23:19.433 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T08:23:19.448 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-11T08:23:19.449 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T08:23:19.459 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:19.470 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:19.548 INFO:teuthology.orchestra.console:Power off smithi092
2023-07-11T08:23:19.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T08:23:19.570 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:19.591 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-11T08:23:19.693 INFO:teuthology.orchestra.console:Power on smithi062
2023-07-11T08:23:19.693 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T08:23:19.714 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:23.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:23.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:23.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:27.851 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:28.122 INFO:teuthology.orchestra.console:Power on for smithi062 completed
2023-07-11T08:23:28.223 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-07-11T08:23:28.224 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T08:23:33.229 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:33.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:38.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:38.348 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:43.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:43.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:48.328 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T08:23:48.613 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:48.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:53.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:53.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:58.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:23:58.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:03.764 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-07-11T08:24:13.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:13.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:13.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:24:13.990 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2023-07-11T08:24:14.090 INFO:teuthology.orchestra.console:Power on smithi092
2023-07-11T08:24:14.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T08:24:14.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:16.880 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T08:24:18.134 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:18.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:22.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:24:23.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:23.997 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:24.207 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2023-07-11T08:24:24.308 INFO:teuthology.orchestra.console:Power on smithi037
2023-07-11T08:24:24.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T08:24:25.936 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-07-11T08:24:28.354 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:28.563 INFO:teuthology.orchestra.console:Power on for smithi092 completed
2023-07-11T08:24:28.664 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2023-07-11T08:24:28.665 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-11T08:24:29.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:24:31.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:24:36.944 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-11T08:24:39.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:42.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:24:47.953 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:51.024 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-11T08:24:53.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:24:53.276 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2023-07-11T08:24:53.377 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2023-07-11T08:24:53.377 DEBUG:teuthology.provision.fog.smithi037:FOG request: GET /task/active None
2023-07-11T08:24:53.426 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:24:56.496 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-07-11T08:24:57.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:00.080 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-11T08:25:02.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:07.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:10.576 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-07-11T08:25:10.577 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-11T08:25:16.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:21.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:24.656 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-11T08:25:24.657 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37
2023-07-11T08:25:30.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:30.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:36.948 WARNING:teuthology.provision.fog.smithi062:timed out
2023-07-11T08:25:42.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:25:48.295 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T08:25:48.296 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T08:25:48.626 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-07-11T08:25:48.627 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-07-11T08:25:48.647 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-07-11T08:25:48.648 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-07-11T08:25:48.708 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-07-11T08:25:48.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-11T08:25:48.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-07-11T08:25:48.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-07-11T08:25:48.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-07-11T08:25:49.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-07-11T08:25:49.077 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-07-11T08:25:49.136 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-07-11T08:25:49.136 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-07-11T08:25:49.136 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T08:25:49.137 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-07-11T08:25:49.138 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T08:25:49.138 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T08:25:49.138 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T08:25:49.139 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-07-11T08:25:49.140 DEBUG:teuthology.parallel:result is None
2023-07-11T08:26:30.700 WARNING:teuthology.provision.fog.smithi092:timed out
2023-07-11T08:26:33.500 WARNING:teuthology.provision.fog.smithi037:timed out
2023-07-11T08:26:36.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:26:37.059 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T08:26:37.060 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T08:26:37.304 INFO:teuthology.provision.fog.smithi092:Node is ready
2023-07-11T08:26:37.304 DEBUG:teuthology.orchestra.run.smithi092:> hostname
2023-07-11T08:26:37.319 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2023-07-11T08:26:37.319 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts
2023-07-11T08:26:37.374 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2023-07-11T08:26:37.374 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-07-11T08:26:37.490 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts
2023-07-11T08:26:37.517 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts
2023-07-11T08:26:37.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname
2023-07-11T08:26:37.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-07-11T08:26:37.709 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-07-11T08:26:37.764 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux"
2023-07-11T08:26:37.764 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.4 (Ootpa)"
2023-07-11T08:26:37.764 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel"
2023-07-11T08:26:37.764 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora"
2023-07-11T08:26:37.764 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.4"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-11T08:26:37.765 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T08:26:37.766 INFO:teuthology.orchestra.run.smithi092.stdout:
2023-07-11T08:26:37.766 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T08:26:37.766 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-07-11T08:26:37.766 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-11T08:26:37.766 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-07-11T08:26:37.767 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi092's OS to be centos 8 but found rhel 8.4
2023-07-11T08:26:37.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T08:26:37.768 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T08:26:42.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T08:26:42.846 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T08:26:53.615 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T08:26:53.616 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T08:26:53.629 INFO:teuthology.provision.fog.smithi037:Node is ready
2023-07-11T08:26:53.629 DEBUG:teuthology.orchestra.run.smithi037:> hostname
2023-07-11T08:26:53.635 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2023-07-11T08:26:53.636 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts
2023-07-11T08:26:53.646 DEBUG:teuthology.nuke:shortname: smithi037
2023-07-11T08:26:53.647 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T08:26:53.670 DEBUG:teuthology.nuke:shortname: smithi062
2023-07-11T08:26:53.670 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T08:26:53.673 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:23:04.218593', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-11T08:26:53.685 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2023-07-11T08:26:53.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2023-07-11T08:26:53.692 DEBUG:teuthology.nuke:shortname: smithi092
2023-07-11T08:26:53.692 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T08:26:53.697 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:23:04.217568', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-11T08:26:53.715 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 08:23:04.216384', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGIYXsAgoMTn3ej5W6wEo5AfGHw5E13bRudq2Yyqi2XieV0+tdcAMq+AXHrdz3aeHOr6GPd0hN2+wCMGzKT7I2I='}
2023-07-11T08:26:53.727 INFO:teuthology.orchestra.console:Power off smithi037
2023-07-11T08:26:53.727 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T08:26:53.746 INFO:teuthology.orchestra.console:Power off smithi062
2023-07-11T08:26:53.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T08:26:53.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:26:53.773 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:26:53.790 INFO:teuthology.orchestra.console:Power off smithi092
2023-07-11T08:26:53.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T08:26:53.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts
2023-07-11T08:26:53.816 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:26:53.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts
2023-07-11T08:26:53.884 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname
2023-07-11T08:26:53.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037
2023-07-11T08:26:53.909 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release
2023-07-11T08:26:53.956 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu"
2023-07-11T08:26:53.956 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-11T08:26:53.956 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu
2023-07-11T08:26:53.956 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian
2023-07-11T08:26:53.956 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-11T08:26:53.957 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04"
2023-07-11T08:26:53.957 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-11T08:26:53.957 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-11T08:26:53.958 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-11T08:26:53.958 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-11T08:26:53.958 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal
2023-07-11T08:26:53.958 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal
2023-07-11T08:26:57.806 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:26:57.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:26:57.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:01.920 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:01.930 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:01.951 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:07.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:07.043 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:07.063 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:12.147 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:12.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:12.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:12.359 INFO:teuthology.orchestra.console:Power off for smithi062 completed
2023-07-11T08:27:22.501 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2023-07-11T08:27:22.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T08:27:22.536 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-07-11T08:27:32.668 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com
2023-07-11T08:27:32.743 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2023-07-11T08:27:33.117 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com
2023-07-11T08:27:33.470 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi092's OS to be centos 8 but found rhel 8.4