2023-07-14T04:10:53.192 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T04:10:53.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:10:53.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:11:07.984 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f17b3520820>, signals=[15]) 2023-07-14T04:11:07.986 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-07-14T04:11:07.986 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:11:07.988 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-14T04:11:08.017 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-07-14T04:11:08.018 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:11:08.018 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-14T04:11:08.019 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-07-14T04:11:18.062 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2023-07-14T04:11:18.062 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T04:11:18.062 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-07-14T04:11:18.064 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-07-14T04:11:27.269 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"} 2023-07-14T04:11:27.277 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:11:27.317 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:11:27.331 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:11:27.331 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 3} 2023-07-14T04:11:27.359 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-14T04:11:27.378 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:11:27.379 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 3} 2023-07-14T04:11:27.391 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 8.stream 2023-07-14T04:11:27.391 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T04:11:27.413 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_8.stream (ID 3) 2023-07-14T04:11:27.414 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 3} 2023-07-14T04:11:27.435 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream 2023-07-14T04:11:27.436 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-14T04:11:27.464 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:11:27.490 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.stream 2023-07-14T04:11:27.490 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-14T04:11:27.509 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:11:27.512 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-07-14T04:11:27.559 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-07-14T04:11:27.565 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T04:11:27.601 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1} 2023-07-14T04:11:27.662 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T04:11:27.689 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-14T04:11:27.691 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-14T04:11:27.793 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-14T04:11:27.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:11:27.813 INFO:teuthology.orchestra.console:Power off smithi134 2023-07-14T04:11:27.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:11:27.838 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-14T04:11:27.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:11:27.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:27.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:27.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:31.880 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:31.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:31.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:35.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:36.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:36.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:36.211 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-14T04:11:36.231 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-14T04:11:36.312 INFO:teuthology.orchestra.console:Power on smithi101 2023-07-14T04:11:36.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:11:36.332 INFO:teuthology.orchestra.console:Power on smithi102 2023-07-14T04:11:36.333 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:11:36.343 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:36.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:40.123 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:40.336 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2023-07-14T04:11:40.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:40.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:40.438 INFO:teuthology.orchestra.console:Power on smithi134 2023-07-14T04:11:40.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T04:11:40.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:44.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:44.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:44.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:49.600 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:49.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:49.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:11:49.831 INFO:teuthology.orchestra.console:Power on for smithi102 completed 2023-07-14T04:11:49.933 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-07-14T04:11:49.933 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-14T04:11:55.042 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-07-14T04:11:55.043 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2023-07-14T04:11:55.143 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-07-14T04:11:55.144 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T04:11:55.145 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2023-07-14T04:11:55.146 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-14T04:12:10.028 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-14T04:12:15.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:20.241 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None 2023-07-14T04:12:25.244 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T04:12:25.247 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-14T04:12:30.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:35.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:35.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:38.388 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-14T04:12:38.389 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-14T04:12:38.389 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T04:12:44.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:45.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:45.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:48.624 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-14T04:12:48.656 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-14T04:12:48.657 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T04:12:54.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:12:59.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:13:04.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:13:18.068 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-14T04:13:23.184 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-14T04:13:24.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:13:27.152 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134 2023-07-14T04:13:29.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:13:34.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:13:39.541 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:13:39.543 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:13:39.685 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T04:13:39.685 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T04:13:40.033 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-07-14T04:13:40.034 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-07-14T04:13:40.084 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-07-14T04:13:40.085 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-07-14T04:13:40.133 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-07-14T04:13:40.133 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-14T04:13:40.248 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-07-14T04:13:40.261 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-07-14T04:13:40.317 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-07-14T04:13:40.372 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-14T04:13:40.423 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-14T04:13:40.468 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-14T04:13:40.468 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T04:13:40.469 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T04:13:40.470 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T04:13:40.470 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T04:13:40.470 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2023-07-14T04:13:40.472 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi102's OS to be centos 8 but found ubuntu 22.04 2023-07-14T04:13:40.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T04:13:40.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T04:13:43.273 INFO:teuthology.provision.fog.smithi134:Node is ready 2023-07-14T04:13:43.274 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2023-07-14T04:13:43.319 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2023-07-14T04:13:43.320 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2023-07-14T04:13:43.368 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2023-07-14T04:13:43.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2023-07-14T04:13:43.382 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T04:13:48.387 DEBUG:teuthology.nuke:shortname: smithi101 2023-07-14T04:13:48.388 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:13:48.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336944', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:11:48.282435', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T04:13:48.416 INFO:teuthology.nuke:Not nuking smithi134.front.sepia.ceph.com because description doesn't match: yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi != /home/teuthworker/archive/yuriw-2023-07-13_23:26:42-fs-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336949 2023-07-14T04:13:48.417 DEBUG:teuthology.nuke:shortname: smithi102 2023-07-14T04:13:48.417 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T04:13:53.456 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336939', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:10:48.080027', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPzI7XjEE8JD/wjjRkINwDVLFpYIE3f8ojmAOPXT0zXzB6nJYaxKKzm25pWraD7mCA7FjOfI5btQDmhrys7kct4='} 2023-07-14T04:13:53.485 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-14T04:13:53.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:13:53.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:13:53.533 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-14T04:13:53.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T04:13:53.559 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:13:57.545 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:13:57.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:01.660 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:01.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:04.641 WARNING:teuthology.provision.fog.smithi101:timed out 2023-07-14T04:14:06.772 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:06.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:10.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:14:11.884 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:11.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T04:14:12.097 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-14T04:14:12.131 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-14T04:14:17.206 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T04:14:27.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:14:37.261 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T04:14:37.297 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-07-14T04:14:37.306 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-07-14T04:14:37.308 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8eGWlbrHoev3b1UW7vn8RHWW3JbYSVng/4S6J/LxcVJeEcFhqmkFVH/e1r1VBO6VT5BcVT6mSuu3ZBQRj7AI4= 2023-07-14T04:14:43.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T04:14:44.273 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi102's OS to be centos 8 but found ubuntu 22.04