2023-07-15T07:31:58.893 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-15T07:31:58.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-15T07:31:58.895 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-15T07:32:04.057 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f19ac41d5b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f19ad6378b0>, signals=[15])
2023-07-15T07:32:04.059 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2023-07-15T07:32:04.059 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2023-07-15T07:32:04.060 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2023-07-15T07:32:14.086 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging
2023-07-15T07:32:14.087 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server
2023-07-15T07:32:14.087 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2023-07-15T07:32:14.089 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"}
2023-07-15T07:32:19.119 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"}
2023-07-15T07:32:29.149 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-15T07:32:39.189 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-15T07:32:43.278 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_8.stream (ID 3)
2023-07-15T07:32:43.278 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 3}
2023-07-15T07:32:43.390 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_centos_8.stream (ID 3)
2023-07-15T07:32:43.391 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 3}
2023-07-15T07:32:43.398 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 8.stream
2023-07-15T07:32:43.399 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-15T07:32:43.494 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of centos 8.stream
2023-07-15T07:32:43.494 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-15T07:32:43.574 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"}
2023-07-15T07:32:48.582 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"}
2023-07-15T07:32:53.624 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1}
2023-07-15T07:32:58.630 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1}
2023-07-15T07:33:03.704 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-15T07:33:03.705 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-15T07:33:20.424 INFO:teuthology.orchestra.console:Power off smithi093
2023-07-15T07:33:20.425 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:33:20.443 INFO:teuthology.orchestra.console:Power off smithi123
2023-07-15T07:33:20.443 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:33:25.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:25.466 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:30.465 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:30.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:30.676 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-07-15T07:33:30.777 INFO:teuthology.orchestra.console:Power on smithi093
2023-07-15T07:33:30.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-15T07:33:30.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:34.820 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:35.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:39.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:40.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:45.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:45.255 INFO:teuthology.orchestra.console:Power on for smithi093 completed
2023-07-15T07:33:45.356 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2023-07-15T07:33:45.356 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None
2023-07-15T07:33:45.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:33:45.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:48.500 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:33:50.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:54.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:33:59.511 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:33:59.720 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2023-07-15T07:33:59.822 INFO:teuthology.orchestra.console:Power on smithi123
2023-07-15T07:33:59.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-15T07:34:02.576 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:34:04.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:08.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:34:09.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:12.916 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:34:14.974 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:18.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:34:20.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:22.000 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:34:25.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:28.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:34:33.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:36.080 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:34:38.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:42.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:34:47.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:52.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:34:52.410 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2023-07-15T07:34:52.511 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2023-07-15T07:34:52.511 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None
2023-07-15T07:34:55.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:34:58.704 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-15T07:35:04.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:35:09.717 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2023-07-15T07:35:12.784 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-15T07:35:15.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:35:20.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:35:25.838 ERROR:teuthology.orchestra.connection:Error authenticating with smithi093.front.sepia.ceph.com: Authentication failed.
2023-07-15T07:35:25.841 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-15T07:35:25.842 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-15T07:35:25.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:26.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:27.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:28.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:29.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:30.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:31.877 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:32.883 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:33.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:34.894 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:35.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:36.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:37.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:38.918 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:39.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:40.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:41.935 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:42.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:43.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:44.244 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-15T07:35:44.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:45.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:46.966 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:47.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:48.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:49.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:50.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:35:55.251 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123
2023-07-15T07:35:55.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:56.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:57.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:58.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:35:59.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:00.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:01.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-15T07:36:06.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:06.463 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-15T07:36:06.463 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-15T07:36:06.977 INFO:teuthology.provision.fog.smithi123:Node is ready
2023-07-15T07:36:06.978 DEBUG:teuthology.orchestra.run.smithi123:> hostname
2023-07-15T07:36:06.984 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com
2023-07-15T07:36:06.984 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts
2023-07-15T07:36:06.991 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123
2023-07-15T07:36:06.992 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-07-15T07:36:07.065 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts
2023-07-15T07:36:07.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts
2023-07-15T07:36:07.140 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname
2023-07-15T07:36:07.157 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123
2023-07-15T07:36:07.169 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release
2023-07-15T07:36:07.175 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu"
2023-07-15T07:36:07.175 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)"
2023-07-15T07:36:07.175 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu
2023-07-15T07:36:07.175 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS"
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04"
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/"
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-07-15T07:36:07.176 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal
2023-07-15T07:36:07.177 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal
2023-07-15T07:36:07.180 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi123's OS to be centos 8 but found ubuntu 20.04
2023-07-15T07:36:07.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-15T07:36:07.182 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-15T07:36:12.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:12.275 INFO:teuthology.nuke:Checking targets against current locks
2023-07-15T07:36:13.212 DEBUG:teuthology.nuke:shortname: smithi093
2023-07-15T07:36:13.213 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-15T07:36:13.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:31:58.113926', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-15T07:36:13.249 DEBUG:teuthology.nuke:shortname: smithi123
2023-07-15T07:36:13.250 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-15T07:36:13.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:13.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:39:06-rados-wip-yuri5-testing-2023-07-14-0757-distro-default-smithi/7338752', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 07:31:58.112166', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'}
2023-07-15T07:36:13.313 INFO:teuthology.orchestra.console:Power off smithi093
2023-07-15T07:36:13.313 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:36:13.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:13.368 INFO:teuthology.orchestra.console:Power off smithi123
2023-07-15T07:36:13.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-15T07:36:13.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:14.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:15.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:16.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:17.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:17.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:17.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:18.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:19.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:20.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-15T07:36:21.491 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:21.533 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:21.702 INFO:teuthology.orchestra.console:Power off for smithi093 completed
2023-07-15T07:36:26.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-15T07:36:26.313 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2023-07-15T07:36:26.470 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2023-07-15T07:36:31.647 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2023-07-15T07:36:31.914 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi123's OS to be centos 8 but found ubuntu 20.04