2023-07-14T00:41:28.945 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-14T00:41:28.946 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:41:28.947 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:41:58.718 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa6f02728b0>, signals=[15]) 2023-07-14T00:41:58.721 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2023-07-14T00:41:58.722 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T00:41:58.722 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-14T00:41:58.746 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-07-14T00:41:58.746 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T00:41:58.747 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-07-14T00:41:58.749 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /host {"name": "smithi040"} 2023-07-14T00:42:03.778 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2023-07-14T00:42:03.778 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2023-07-14T00:42:03.778 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2023-07-14T00:42:03.780 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-07-14T00:42:14.595 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"} 2023-07-14T00:42:14.624 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T00:42:19.646 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T00:42:19.646 DEBUG:teuthology.provision.fog.smithi040:FOG request: PUT /host/145 {"imageID": 5} 2023-07-14T00:42:24.679 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T00:42:28.342 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of rhel 8.6 2023-07-14T00:42:28.343 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-14T00:42:28.345 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-14T00:42:38.405 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T00:42:38.405 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 5} 2023-07-14T00:42:43.373 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T00:42:43.375 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-14T00:42:43.375 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 5} 2023-07-14T00:42:43.477 DEBUG:teuthology.provision.fog.smithi040:FOG request: POST /host/145/task {"taskTypeID": 1} 2023-07-14T00:42:43.495 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.6 2023-07-14T00:42:43.496 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T00:42:43.500 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of rhel 8.6 2023-07-14T00:42:43.501 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-14T00:42:43.626 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-14T00:42:43.656 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T00:42:43.673 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"} 2023-07-14T00:42:43.724 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1} 2023-07-14T00:42:43.732 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-07-14T00:42:46.750 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T00:42:46.752 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-14T00:42:46.821 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-14T00:42:46.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:42:46.848 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:46.873 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-14T00:42:46.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:42:46.897 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-14T00:42:46.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:42:46.907 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:46.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:46.987 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-14T00:42:47.034 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-14T00:42:47.089 INFO:teuthology.orchestra.console:Power on smithi040 2023-07-14T00:42:47.089 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T00:42:47.114 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:47.135 INFO:teuthology.orchestra.console:Power on smithi169 2023-07-14T00:42:47.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T00:42:47.159 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:50.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:51.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:51.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:56.059 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:56.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:42:56.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:01.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:01.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:01.384 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-14T00:43:01.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:01.486 INFO:teuthology.orchestra.console:Power on smithi101 2023-07-14T00:43:01.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-14T00:43:01.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:05.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:06.489 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:06.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:06.701 INFO:teuthology.orchestra.console:Power on for smithi040 completed 2023-07-14T00:43:06.802 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2023-07-14T00:43:06.803 DEBUG:teuthology.provision.fog.smithi040:FOG request: GET /task/active None 2023-07-14T00:43:09.748 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:09.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:10.049 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-07-14T00:43:10.150 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-07-14T00:43:10.150 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-07-14T00:43:10.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:12.884 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-14T00:43:13.268 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T00:43:13.757 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:18.872 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:43:18.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:23.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:24.000 INFO:teuthology.orchestra.console:Power on for smithi169 completed 2023-07-14T00:43:24.101 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2023-07-14T00:43:24.101 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None 2023-07-14T00:43:29.108 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T00:43:29.109 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-14T00:43:29.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:35.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:40.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:44.439 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T00:43:44.439 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-14T00:43:47.504 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2023-07-14T00:43:50.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:55.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:55.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:43:58.512 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T00:43:58.516 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2023-07-14T00:44:04.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:44:04.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:44:07.604 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-07-14T00:44:13.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:44:55.491 WARNING:teuthology.provision.fog.smithi040:timed out 2023-07-14T00:45:01.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:45:06.500 WARNING:teuthology.provision.fog.smithi169:timed out 2023-07-14T00:45:06.615 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T00:45:06.616 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T00:45:07.165 INFO:teuthology.provision.fog.smithi040:Node is ready 2023-07-14T00:45:07.166 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2023-07-14T00:45:07.214 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2023-07-14T00:45:07.215 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2023-07-14T00:45:07.263 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2023-07-14T00:45:07.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-14T00:45:07.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2023-07-14T00:45:07.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2023-07-14T00:45:07.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2023-07-14T00:45:07.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2023-07-14T00:45:07.571 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-14T00:45:07.618 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Ubuntu" 2023-07-14T00:45:07.618 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-14T00:45:07.618 INFO:teuthology.orchestra.run.smithi040.stdout:ID=ubuntu 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE=debian 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="20.04" 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T00:45:07.619 INFO:teuthology.orchestra.run.smithi040.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T00:45:07.620 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_CODENAME=focal 2023-07-14T00:45:07.620 INFO:teuthology.orchestra.run.smithi040.stdout:UBUNTU_CODENAME=focal 2023-07-14T00:45:07.623 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi040's OS to be rhel 8.6 but found ubuntu 20.04 2023-07-14T00:45:07.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-14T00:45:07.624 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-14T00:45:09.957 INFO:teuthology.nuke:Checking targets against current locks 2023-07-14T00:45:14.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:45:19.969 WARNING:teuthology.provision.fog.smithi101:timed out 2023-07-14T00:45:30.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-14T00:45:36.536 DEBUG:teuthology.nuke:shortname: smithi040 2023-07-14T00:45:36.537 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T00:45:36.585 DEBUG:teuthology.nuke:shortname: smithi101 2023-07-14T00:45:36.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T00:45:36.589 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 00:41:21.812965', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-14T00:45:36.610 DEBUG:teuthology.nuke:shortname: smithi169 2023-07-14T00:45:36.610 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-14T00:45:36.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 00:41:21.812022', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-14T00:45:36.637 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-13_21:35:13-fs-wip-rishabh-2023Jul13-testing-default-smithi/7336426', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 00:41:21.810235', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-07-14T00:45:36.655 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-14T00:45:36.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:45:46.684 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T00:45:46.685 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T00:45:46.686 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-14T00:45:46.686 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-14T00:45:46.687 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:45:46.714 INFO:teuthology.orchestra.console:Power off smithi169 2023-07-14T00:45:46.715 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:45:46.732 INFO:teuthology.orchestra.console:Power off smithi101 2023-07-14T00:45:46.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-14T00:45:46.768 INFO:teuthology.provision.fog.smithi169:Node is ready 2023-07-14T00:45:46.769 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2023-07-14T00:45:46.774 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2023-07-14T00:45:46.775 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2023-07-14T00:45:46.823 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-07-14T00:45:46.824 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-07-14T00:45:46.825 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2023-07-14T00:45:46.825 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-14T00:45:46.843 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101 2023-07-14T00:45:46.844 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101 /etc/hosts 2023-07-14T00:45:46.903 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-07-14T00:45:46.903 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101 smithi101 2023-07-14T00:45:46.903 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-14T00:45:46.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2023-07-14T00:45:46.969 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2023-07-14T00:45:47.025 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2023-07-14T00:45:47.042 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101/smithi101/g' /etc/hosts 2023-07-14T00:45:47.073 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-07-14T00:45:47.081 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2023-07-14T00:45:47.137 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2023-07-14T00:45:47.142 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101/smithi101/g' /etc/hostname 2023-07-14T00:45:47.184 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2023-07-14T00:45:47.184 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-14T00:45:47.184 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2023-07-14T00:45:47.184 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="20.04" 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-14T00:45:47.185 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=focal 2023-07-14T00:45:47.186 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=focal 2023-07-14T00:45:47.210 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-07-14T00:45:47.277 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-07-14T00:45:47.334 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-07-14T00:45:47.334 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.6 (Ootpa)" 2023-07-14T00:45:47.334 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-07-14T00:45:47.334 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.6" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-07-14T00:45:47.335 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-14T00:45:47.336 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-14T00:45:47.336 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-07-14T00:45:47.336 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-14T00:45:47.336 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-14T00:45:47.336 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-14T00:45:47.336 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-14T00:45:47.337 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-07-14T00:45:51.700 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:45:51.744 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:45:51.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:45:56.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:45:56.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:45:56.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:00.868 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:01.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:01.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:05.986 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:06.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:07.034 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:07.209 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-07-14T00:46:08.063 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-07-14T00:46:11.098 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:11.310 INFO:teuthology.orchestra.console:Power off for smithi169 completed 2023-07-14T00:46:16.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-14T00:46:21.486 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com 2023-07-14T00:46:21.562 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-14T00:46:24.953 INFO:teuthology.lock.ops:unlocked: smithi040.front.sepia.ceph.com 2023-07-14T00:46:25.346 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 92, in create self._verify_installed_os() File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 348, in _verify_installed_os raise RuntimeError( RuntimeError: Expected smithi040's OS to be rhel 8.6 but found ubuntu 20.04