2023-07-25T13:51:32.107 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-25T13:51:32.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T13:51:32.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T13:51:52.015 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb834c1ccd0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb8345db430>, signals=[15])
2023-07-25T13:51:52.017 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2023-07-25T13:51:52.017 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2023-07-25T13:51:52.017 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2023-07-25T13:51:57.054 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-07-25T13:51:57.054 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-07-25T13:51:57.054 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-07-25T13:51:57.055 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"}
2023-07-25T13:52:07.086 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-07-25T13:52:12.031 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-25T13:52:12.035 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-25T13:52:12.079 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-25T13:52:12.080 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 5}
2023-07-25T13:52:12.085 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-25T13:52:12.086 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 5}
2023-07-25T13:52:12.116 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of rhel 8.6
2023-07-25T13:52:12.116 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:52:17.121 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6
2023-07-25T13:52:17.122 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-07-25T13:52:22.188 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"}
2023-07-25T13:52:27.194 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-07-25T13:52:32.239 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1}
2023-07-25T13:52:37.246 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-07-25T13:52:42.307 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:52:42.323 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-07-25T13:52:52.413 INFO:teuthology.orchestra.console:Power off smithi107
2023-07-25T13:52:52.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T13:52:52.427 INFO:teuthology.orchestra.console:Power off smithi019
2023-07-25T13:52:52.428 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T13:52:52.436 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T13:52:52.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:52:52.447 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T13:52:52.447 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:52:52.456 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T13:52:52.469 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T13:52:52.569 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2023-07-25T13:52:52.670 INFO:teuthology.orchestra.console:Power on smithi019
2023-07-25T13:52:52.671 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-25T13:52:52.691 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-25T13:52:52.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:52:52.719 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T13:52:56.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:52:56.571 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T13:52:56.720 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:52:56.831 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T13:52:56.932 INFO:teuthology.orchestra.console:Power on for smithi019 completed
2023-07-25T13:52:57.033 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2023-07-25T13:52:57.033 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:53:02.042 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:53:03.151 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:53:07.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:53:07.261 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T13:53:07.363 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-07-25T13:53:07.463 INFO:teuthology.orchestra.console:Power on smithi107
2023-07-25T13:53:07.464 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-25T13:53:07.485 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-25T13:53:07.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:53:07.505 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T13:53:11.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:53:12.617 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:53:16.618 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:53:16.728 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T13:53:16.829 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2023-07-25T13:53:16.929 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2023-07-25T13:53:16.930 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-07-25T13:53:17.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:53:17.126 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:53:20.080 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:53:26.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:53:29.140 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:53:32.192 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:53:37.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:53:45.264 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:53:51.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:53:54.320 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:53:57.267 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:54:00.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:54:03.376 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:54:09.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:54:14.386 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:54:19.393 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:54:25.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:54:34.470 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-07-25T13:54:39.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:54:44.644 ERROR:teuthology.orchestra.connection:Error authenticating with smithi019.front.sepia.ceph.com: Authentication failed.
2023-07-25T13:54:44.646 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-25T13:54:44.647 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-25T13:54:44.647 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:45.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:46.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:47.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:48.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:48.816 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:54:49.671 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:50.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:51.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:52.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:53.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:54.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:54:54.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:54:59.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:00.827 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:01.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:02.837 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:02.900 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-07-25T13:55:03.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:04.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:05.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:06.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:07.864 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:08.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:08.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-25T13:55:09.332 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-25T13:55:09.332 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-25T13:55:09.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:10.154 INFO:teuthology.provision.fog.smithi107:Node is ready
2023-07-25T13:55:10.155 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2023-07-25T13:55:10.205 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2023-07-25T13:55:10.205 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2023-07-25T13:55:10.247 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2023-07-25T13:55:10.247 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-07-25T13:55:10.426 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2023-07-25T13:55:10.497 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2023-07-25T13:55:10.574 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2023-07-25T13:55:10.650 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-07-25T13:55:10.721 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2023-07-25T13:55:10.760 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2023-07-25T13:55:10.760 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2023-07-25T13:55:10.761 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2023-07-25T13:55:10.762 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-25T13:55:10.762 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2023-07-25T13:55:10.762 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-25T13:55:10.762 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-25T13:55:10.762 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-25T13:55:10.764 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi107's OS to be rhel 8.6 but found centos 9
2023-07-25T13:55:10.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-25T13:55:10.765 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-25T13:55:10.853 INFO:teuthology.nuke:Checking targets against current locks
2023-07-25T13:55:10.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:10.902 DEBUG:teuthology.nuke:shortname: smithi019
2023-07-25T13:55:10.903 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-25T13:55:10.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:25:54-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7350640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 13:51:31.241174', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMjRQX6QACeZMpZFekugrU4ejiTy3awiYyS/smfRtKHegyRCTnbK8cWk60YyVgyAn1ACdBeEtxzNj1Lo7DlV6zw='}
2023-07-25T13:55:10.931 DEBUG:teuthology.nuke:shortname: smithi107
2023-07-25T13:55:10.932 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-25T13:55:10.955 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:25:54-fs-wip-vshankar-testing-20230725.053049-testing-default-smithi/7350640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 13:51:31.242795', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMhGBovDFatV7P/b7VMwRhweVG/LMooiJPclCK4jk+fPdLsteEfl4IT3IVbTbfAwVBI1/n39YdutXX8r0lGXcUA='}
2023-07-25T13:55:10.967 INFO:teuthology.orchestra.console:Power off smithi019
2023-07-25T13:55:10.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T13:55:10.989 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T13:55:10.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:11.006 INFO:teuthology.orchestra.console:Power off smithi107
2023-07-25T13:55:11.007 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-25T13:55:11.017 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T13:55:11.028 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-25T13:55:11.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:11.052 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-25T13:55:11.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:12.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:13.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:14.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:15.017 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:15.053 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:15.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:16.128 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:16.163 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:16.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:17.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-25T13:55:20.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:20.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:20.241 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-25T13:55:20.343 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2023-07-25T13:55:23.781 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:23.841 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2023-07-25T13:55:27.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:28.893 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:32.895 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:34.007 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:38.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:39.119 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:43.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:44.230 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:48.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:49.342 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:53.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:54.455 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:55:58.456 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:55:59.567 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:56:03.567 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:56:04.678 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:56:08.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:56:09.790 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:56:13.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:56:14.900 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:56:18.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:56:20.011 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:56:24.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-25T13:56:25.123 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-25T13:56:25.124 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-25T13:56:25.124 ERROR:teuthology.orchestra.console:Failed to power off smithi107
2023-07-25T13:56:38.807 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2023-07-25T13:56:44.048 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi107's OS to be rhel 8.6 but found centos 9