2023-07-26T02:05:35.327 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-26T02:05:35.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T02:05:35.329 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T02:05:50.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd319a6fd60>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd3193ec430>, signals=[15])
2023-07-26T02:05:50.445 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2023-07-26T02:05:50.445 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T02:05:50.446 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2023-07-26T02:05:55.469 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging
2023-07-26T02:05:55.469 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T02:05:55.469 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server
2023-07-26T02:05:55.471 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"}
2023-07-26T02:06:05.501 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"}
2023-07-26T02:06:15.537 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-26T02:06:20.575 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-26T02:06:20.588 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_8.stream (ID 3)
2023-07-26T02:06:20.589 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 3}
2023-07-26T02:06:20.620 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3)
2023-07-26T02:06:20.621 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 3}
2023-07-26T02:06:20.648 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream
2023-07-26T02:06:20.649 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-07-26T02:06:20.668 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream
2023-07-26T02:06:20.668 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-26T02:06:20.712 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T02:06:20.739 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T02:06:20.756 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1}
2023-07-26T02:06:25.765 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1}
2023-07-26T02:06:35.828 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-07-26T02:06:40.810 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-26T02:06:46.813 INFO:teuthology.orchestra.console:Power off smithi105
2023-07-26T02:06:46.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T02:06:46.836 INFO:teuthology.orchestra.console:Power off smithi081
2023-07-26T02:06:46.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T02:06:46.848 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T02:06:46.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:46.862 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T02:06:46.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:46.873 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:06:46.885 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T02:06:46.974 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-07-26T02:06:47.075 INFO:teuthology.orchestra.console:Power on smithi105
2023-07-26T02:06:47.075 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T02:06:47.095 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T02:06:47.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:47.118 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:06:50.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:51.119 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:51.999 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:06:52.230 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:06:56.001 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:56.232 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:06:57.111 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:06:57.343 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:07:01.112 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:01.345 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:02.222 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:07:02.456 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:07:06.223 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:06.457 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:07.334 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:07:07.571 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:07:11.335 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:11.572 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:11.682 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T02:07:11.783 INFO:teuthology.orchestra.console:Power on for smithi105 completed
2023-07-26T02:07:11.884 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish
2023-07-26T02:07:11.884 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None
2023-07-26T02:07:16.889 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:07:16.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:07:16.990 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2023-07-26T02:07:17.091 INFO:teuthology.orchestra.console:Power on smithi081
2023-07-26T02:07:17.091 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T02:07:17.112 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T02:07:17.113 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:17.134 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:07:20.052 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-26T02:07:21.136 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:21.249 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:07:25.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:26.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:07:31.062 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:07:34.132 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-26T02:07:35.064 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:07:35.303 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T02:07:35.404 INFO:teuthology.orchestra.console:Power on for smithi081 completed
2023-07-26T02:07:35.505 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2023-07-26T02:07:35.505 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None
2023-07-26T02:07:37.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:07:40.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:07:40.176 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-07-26T02:07:43.220 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-26T02:07:46.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:07:51.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:07:56.193 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-07-26T02:07:59.248 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-26T02:08:02.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:08:07.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:08:17.209 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-07-26T02:08:23.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:08:26.292 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-07-26T02:08:32.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:08:35.696 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105
2023-07-26T02:08:41.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:08:46.930 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T02:08:46.931 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T02:08:47.290 INFO:teuthology.provision.fog.smithi105:Node is ready
2023-07-26T02:08:47.290 DEBUG:teuthology.orchestra.run.smithi105:> hostname
2023-07-26T02:08:47.305 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com
2023-07-26T02:08:47.306 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts
2023-07-26T02:08:47.360 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105
2023-07-26T02:08:47.360 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-07-26T02:08:47.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts
2023-07-26T02:08:47.500 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts
2023-07-26T02:08:47.567 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname
2023-07-26T02:08:47.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105
2023-07-26T02:08:47.701 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release
2023-07-26T02:08:47.755 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream"
2023-07-26T02:08:47.756 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9"
2023-07-26T02:08:47.756 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos"
2023-07-26T02:08:47.756 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T02:08:47.757 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/"
2023-07-26T02:08:47.758 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T02:08:47.758 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T02:08:47.758 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T02:08:47.760 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi105's OS to be centos 8 but found centos 9
2023-07-26T02:08:47.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T02:08:47.761 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T02:08:49.274 INFO:teuthology.nuke:Checking targets against current locks
2023-07-26T02:08:49.328 DEBUG:teuthology.nuke:shortname: smithi081
2023-07-26T02:08:49.329 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-26T02:08:49.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_15:03:30-fs-reef-release-distro-default-smithi/7351528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 02:05:19.643794', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-26T02:08:49.358 DEBUG:teuthology.nuke:shortname: smithi105
2023-07-26T02:08:49.358 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-26T02:08:49.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-25_15:03:30-fs-reef-release-distro-default-smithi/7351528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 02:05:19.645633', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-26T02:08:49.414 INFO:teuthology.orchestra.console:Power off smithi081
2023-07-26T02:08:49.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T02:08:49.442 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T02:08:49.443 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:08:49.466 INFO:teuthology.orchestra.console:Power off smithi105
2023-07-26T02:08:49.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T02:08:49.479 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T02:08:49.491 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T02:08:49.492 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:08:49.521 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T02:08:53.482 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:08:53.523 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:08:54.596 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:08:54.636 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:08:58.597 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:08:58.637 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:08:59.711 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:08:59.748 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:03.712 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:03.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:04.822 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:04.859 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:08.828 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:08.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:09.939 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:09.971 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:13.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:13.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:15.052 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:15.086 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:19.058 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:19.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:20.169 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:20.198 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:24.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:24.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:24.284 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:09:24.386 INFO:teuthology.orchestra.console:Power off for smithi081 completed
2023-07-26T02:09:25.326 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:25.386 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com
2023-07-26T02:09:29.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:30.439 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:32.300 WARNING:teuthology.provision.fog.smithi081:timed out
2023-07-26T02:09:34.440 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:35.551 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:38.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:09:39.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:40.663 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:44.665 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:45.775 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:49.780 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:50.891 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:54.893 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:09:56.008 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T02:09:56.852 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-07-26T02:10:00.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T02:10:00.122 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T02:10:00.223 INFO:teuthology.orchestra.console:Power off for smithi105 completed
2023-07-26T02:10:05.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T02:10:10.365 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2023-07-26T02:10:10.392 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com
2023-07-26T02:10:13.372 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi105's OS to be centos 8 but found centos 9