2023-06-28T08:35:53.519 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T08:35:53.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T08:35:53.521 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T08:35:53.712 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f43032e25e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4302c46430>, signals=[15])
2023-06-28T08:35:53.714 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging
2023-06-28T08:35:53.715 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T08:35:53.715 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server
2023-06-28T08:35:53.738 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-06-28T08:35:53.739 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T08:35:53.739 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-06-28T08:35:53.742 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"}
2023-06-28T08:36:16.751 INFO:teuthology.lock.ops:Start node 'smithi196.front.sepia.ceph.com' reimaging
2023-06-28T08:36:16.752 INFO:teuthology.lock.ops:Updating [smithi196.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T08:36:16.752 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server
2023-06-28T08:36:16.753 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"}
2023-06-28T08:36:21.687 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T08:36:21.717 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /host {"name": "smithi196"}
2023-06-28T08:36:21.743 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T08:36:21.744 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 3}
2023-06-28T08:36:23.101 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T08:36:23.104 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-28T08:36:23.120 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.stream
2023-06-28T08:36:23.120 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-28T08:36:23.146 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T08:36:23.147 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 3}
2023-06-28T08:36:23.150 DEBUG:teuthology.provision.fog.smithi196:Requesting image smithi_centos_8.stream (ID 3)
2023-06-28T08:36:23.150 DEBUG:teuthology.provision.fog.smithi196:FOG request: PUT /host/301 {"imageID": 3}
2023-06-28T08:36:23.207 INFO:teuthology.provision.fog.smithi196:Scheduling deploy of centos 8.stream
2023-06-28T08:36:23.207 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-06-28T08:36:23.210 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream
2023-06-28T08:36:23.210 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-06-28T08:36:23.231 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T08:36:23.276 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1}
2023-06-28T08:36:23.310 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T08:36:23.318 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T08:36:23.340 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-28T08:36:23.360 DEBUG:teuthology.provision.fog.smithi196:FOG request: POST /host/301/task {"taskTypeID": 1}
2023-06-28T08:36:23.364 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1}
2023-06-28T08:36:23.426 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-06-28T08:36:23.428 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-06-28T08:36:23.489 INFO:teuthology.orchestra.console:Power off smithi031
2023-06-28T08:36:23.490 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T08:36:23.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:23.579 INFO:teuthology.orchestra.console:Power off smithi196
2023-06-28T08:36:23.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T08:36:23.598 INFO:teuthology.orchestra.console:Power off smithi120
2023-06-28T08:36:23.599 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T08:36:23.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:23.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:23.638 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-06-28T08:36:23.740 INFO:teuthology.orchestra.console:Power on smithi031
2023-06-28T08:36:23.740 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T08:36:23.765 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:27.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:27.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:27.787 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:27.999 INFO:teuthology.orchestra.console:Power on for smithi031 completed
2023-06-28T08:36:28.100 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish
2023-06-28T08:36:28.100 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None
2023-06-28T08:36:33.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:33.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:33.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:36:33.320 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-06-28T08:36:33.328 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2023-06-28T08:36:33.421 INFO:teuthology.orchestra.console:Power on smithi196
2023-06-28T08:36:33.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T08:36:33.432 INFO:teuthology.orchestra.console:Power on smithi120
2023-06-28T08:36:33.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T08:36:38.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:38.462 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:43.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:43.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:48.577 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:48.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:48.789 INFO:teuthology.orchestra.console:Power on for smithi196 completed
2023-06-28T08:36:48.891 INFO:teuthology.provision.fog.smithi196:Waiting for deploy to finish
2023-06-28T08:36:48.891 DEBUG:teuthology.provision.fog.smithi196:FOG request: GET /task/active None
2023-06-28T08:36:48.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:36:51.700 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-28T08:36:53.703 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:36:57.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:02.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:37:03.865 INFO:teuthology.orchestra.console:Power on for smithi120 completed
2023-06-28T08:37:03.967 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-06-28T08:37:03.970 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-06-28T08:37:04.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:05.776 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-28T08:37:07.312 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-06-28T08:37:11.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:13.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:14.832 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-28T08:37:16.368 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-06-28T08:37:20.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:25.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:30.849 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:37:33.904 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-06-28T08:37:36.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:41.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:46.864 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:37:46.865 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-28T08:37:49.936 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-06-28T08:37:52.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:37:57.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:38:02.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:38:07.879 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31
2023-06-28T08:38:13.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:38:19.101 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T08:38:19.102 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T08:38:19.830 INFO:teuthology.provision.fog.smithi031:Node is ready
2023-06-28T08:38:19.830 DEBUG:teuthology.orchestra.run.smithi031:> hostname
2023-06-28T08:38:19.877 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com
2023-06-28T08:38:19.877 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts
2023-06-28T08:38:19.925 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031
2023-06-28T08:38:19.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-06-28T08:38:20.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts
2023-06-28T08:38:20.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts
2023-06-28T08:38:20.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname
2023-06-28T08:38:20.152 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031
2023-06-28T08:38:20.209 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release
2023-06-28T08:38:20.257 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-06-28T08:38:20.257 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu"
2023-06-28T08:38:20.257 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04"
2023-06-28T08:38:20.257 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-06-28T08:38:20.257 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy
2023-06-28T08:38:20.257 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu
2023-06-28T08:38:20.258 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian
2023-06-28T08:38:20.258 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/"
2023-06-28T08:38:20.258 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-06-28T08:38:20.258 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-06-28T08:38:20.258 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-06-28T08:38:20.258 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy
2023-06-28T08:38:20.260 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi031's OS to be centos 8 but found ubuntu 22.04
2023-06-28T08:38:20.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T08:38:20.262 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T08:38:25.354 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T08:38:30.010 WARNING:teuthology.provision.fog.smithi196:[Errno None] Unable to connect to port 22 on 172.21.15.196
2023-06-28T08:38:33.189 DEBUG:teuthology.nuke:shortname: smithi031
2023-06-28T08:38:33.190 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T08:38:33.260 DEBUG:teuthology.nuke:shortname: smithi120
2023-06-28T08:38:33.261 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T08:38:33.276 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:53:08-rados-reef-release-distro-default-smithi/7319283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 08:35:52.652663', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOJwYzVAJasXBNIF7NkC/FApokbGQ/Xt+S7JDYNI88Io'}
2023-06-28T08:38:33.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:53:08-rados-reef-release-distro-default-smithi/7319283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 08:35:52.651418', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-28T08:38:33.345 DEBUG:teuthology.nuke:shortname: smithi196
2023-06-28T08:38:33.345 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T08:38:38.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:38:53.399 INFO:teuthology.orchestra.console:Power off smithi031
2023-06-28T08:38:53.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T08:38:53.413 INFO:teuthology.orchestra.console:Power off smithi120
2023-06-28T08:38:53.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T08:38:53.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:53:08-rados-reef-release-distro-default-smithi/7319283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 08:35:52.648622', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-06-28T08:38:58.430 WARNING:teuthology.provision.fog.smithi120:timed out
2023-06-28T08:39:03.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:03.495 INFO:teuthology.orchestra.console:Power off smithi196
2023-06-28T08:39:03.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T08:39:03.709 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T08:39:03.710 DEBUG:teuthology.orchestra.run.smithi196:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T08:39:03.937 INFO:teuthology.provision.fog.smithi196:Node is ready
2023-06-28T08:39:03.937 DEBUG:teuthology.orchestra.run.smithi196:> hostname
2023-06-28T08:39:03.995 INFO:teuthology.orchestra.run.smithi196.stdout:smithi196.front.sepia.ceph.com
2023-06-28T08:39:03.996 DEBUG:teuthology.orchestra.run.smithi196:> grep smithi196.front.sepia.ceph.com /etc/hosts
2023-06-28T08:39:04.055 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.15.196 smithi196.front.sepia.ceph.com smithi196
2023-06-28T08:39:04.056 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-06-28T08:39:04.171 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hosts
2023-06-28T08:39:04.201 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/172.21.15.196/172.21.15.196/g' /etc/hosts
2023-06-28T08:39:04.273 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i -e 's/smithi196.front.sepia.ceph.com/smithi196/g' /etc/hostname
2023-06-28T08:39:04.341 DEBUG:teuthology.orchestra.run.smithi196:> sudo hostname smithi196
2023-06-28T08:39:04.407 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release
2023-06-28T08:39:04.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:39:09.440 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:39:09.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:09.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:09.459 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="Red Hat Enterprise Linux"
2023-06-28T08:39:09.460 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="8.6 (Ootpa)"
2023-06-28T08:39:09.460 INFO:teuthology.orchestra.run.smithi196.stdout:ID="rhel"
2023-06-28T08:39:09.460 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="fedora"
2023-06-28T08:39:09.460 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="8.6"
2023-06-28T08:39:09.460 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el8"
2023-06-28T08:39:09.460 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31"
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://www.redhat.com/"
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:
2023-06-28T08:39:09.461 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-28T08:39:09.462 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-28T08:39:09.462 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-28T08:39:09.462 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-28T08:39:13.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:14.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:14.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:15.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:39:18.552 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:19.569 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:19.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:21.556 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:39:23.663 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:24.681 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:24.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:27.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:39:32.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:32.573 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:32.581 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:35.632 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:39:37.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:37.684 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:37.691 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:41.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:39:46.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:46.648 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:46.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:49.712 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:39:51.752 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:51.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:51.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:39:55.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:40:00.721 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:00.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:00.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:03.792 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:40:05.831 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:05.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:05.846 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:09.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:40:14.803 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:14.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:14.819 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:15.029 INFO:teuthology.orchestra.console:Power off for smithi031 completed
2023-06-28T08:40:20.141 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:40:25.167 INFO:teuthology.orchestra.console:Power off for smithi120 completed
2023-06-28T08:40:25.168 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T08:40:25.209 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com
2023-06-28T08:40:30.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:40:35.141 INFO:teuthology.orchestra.console:Power off for smithi196 completed
2023-06-28T08:40:35.142 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:40:35.167 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com
2023-06-28T08:40:36.336 INFO:teuthology.lock.ops:unlocked: smithi196.front.sepia.ceph.com
2023-06-28T08:40:41.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T08:40:46.567 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-06-28T08:40:46.691 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 338, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi031's OS to be centos 8 but found ubuntu 22.04