2023-06-24T14:31:57.574 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-24T14:31:57.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-24T14:31:57.576 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-24T14:32:17.516 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f82f384e6d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f82f31b6550>, signals=[15])
2023-06-24T14:32:17.518 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2023-06-24T14:32:17.518 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2023-06-24T14:32:17.518 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-06-24T14:32:17.546 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging
2023-06-24T14:32:17.546 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server
2023-06-24T14:32:17.547 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server
2023-06-24T14:32:17.548 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"}
2023-06-24T14:32:19.271 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /host {"name": "smithi202"}
2023-06-24T14:32:29.338 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-24T14:32:29.748 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-24T14:32:29.792 DEBUG:teuthology.provision.fog.smithi202:Requesting image smithi_centos_8.stream (ID 3)
2023-06-24T14:32:29.792 DEBUG:teuthology.provision.fog.smithi202:FOG request: PUT /host/306 {"imageID": 3}
2023-06-24T14:32:29.800 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3)
2023-06-24T14:32:29.800 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 3}
2023-06-24T14:32:29.846 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of centos 8.stream
2023-06-24T14:32:29.846 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None
2023-06-24T14:32:39.858 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream
2023-06-24T14:32:39.858 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-06-24T14:32:44.947 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /tasktype {"name": "deploy"}
2023-06-24T14:32:49.952 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"}
2023-06-24T14:32:54.788 DEBUG:teuthology.provision.fog.smithi202:FOG request: POST /host/306/task {"taskTypeID": 1}
2023-06-24T14:32:54.799 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1}
2023-06-24T14:32:54.856 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-06-24T14:32:54.858 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None
2023-06-24T14:33:04.971 INFO:teuthology.orchestra.console:Power off smithi202
2023-06-24T14:33:04.972 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-24T14:33:04.988 INFO:teuthology.orchestra.console:Power off smithi133
2023-06-24T14:33:04.989 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-24T14:33:04.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:05.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:05.122 INFO:teuthology.orchestra.console:Power off for smithi202 completed
2023-06-24T14:33:05.133 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2023-06-24T14:33:05.224 INFO:teuthology.orchestra.console:Power on smithi202
2023-06-24T14:33:05.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-24T14:33:05.234 INFO:teuthology.orchestra.console:Power on smithi133
2023-06-24T14:33:05.235 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-24T14:33:05.245 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:05.260 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:09.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:09.282 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:14.385 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:14.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:33:14.611 INFO:teuthology.orchestra.console:Power on for smithi133 completed
2023-06-24T14:33:14.712 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2023-06-24T14:33:14.713 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-06-24T14:33:19.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:24.781 INFO:teuthology.orchestra.console:Power on for smithi202 completed
2023-06-24T14:33:24.882 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish
2023-06-24T14:33:24.882 DEBUG:teuthology.provision.fog.smithi202:FOG request: GET /task/active None
2023-06-24T14:33:24.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:27.860 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:33:27.984 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:33:33.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:38.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:41.940 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:33:41.941 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:33:47.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:47.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:51.028 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:33:51.029 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:33:57.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:33:57.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:00.112 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:34:00.113 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:34:06.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:06.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:09.168 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:34:09.169 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:34:15.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:15.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:18.224 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:34:18.225 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:34:24.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:29.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:37.296 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:34:43.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:46.352 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:34:47.796 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:34:52.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:53.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:34:55.412 WARNING:teuthology.provision.fog.smithi202:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-06-24T14:34:56.880 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:35:01.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi202.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:35:01.917 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-24T14:35:01.918 DEBUG:teuthology.orchestra.run.smithi202:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-24T14:35:02.143 INFO:teuthology.provision.fog.smithi202:Node is ready
2023-06-24T14:35:02.143 DEBUG:teuthology.orchestra.run.smithi202:> hostname
2023-06-24T14:35:02.160 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com
2023-06-24T14:35:02.160 DEBUG:teuthology.orchestra.run.smithi202:> grep smithi202.front.sepia.ceph.com /etc/hosts
2023-06-24T14:35:02.219 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202
2023-06-24T14:35:02.220 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202
2023-06-24T14:35:02.354 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hosts
2023-06-24T14:35:02.382 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/172.21.15.202/172.21.15.202/g' /etc/hosts
2023-06-24T14:35:02.451 DEBUG:teuthology.orchestra.run.smithi202:> sudo sed -i -e 's/smithi202.front.sepia.ceph.com/smithi202/g' /etc/hostname
2023-06-24T14:35:02.519 DEBUG:teuthology.orchestra.run.smithi202:> sudo hostname smithi202
2023-06-24T14:35:02.585 DEBUG:teuthology.orchestra.run.smithi202:> cat /etc/os-release
2023-06-24T14:35:02.643 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="CentOS Stream"
2023-06-24T14:35:02.644 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8"
2023-06-24T14:35:02.644 INFO:teuthology.orchestra.run.smithi202.stdout:ID="centos"
2023-06-24T14:35:02.644 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="rhel fedora"
2023-06-24T14:35:02.645 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8"
2023-06-24T14:35:02.645 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8"
2023-06-24T14:35:02.645 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="CentOS Stream 8"
2023-06-24T14:35:02.645 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31"
2023-06-24T14:35:02.645 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-06-24T14:35:02.645 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://centos.org/"
2023-06-24T14:35:02.646 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-24T14:35:02.646 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-24T14:35:02.646 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-24T14:35:02.647 INFO:teuthology.provision.fog.smithi202:Deploy complete!
2023-06-24T14:35:02.648 DEBUG:teuthology.parallel:result is None
2023-06-24T14:35:02.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:35:02.884 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-06-24T14:35:08.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-24T14:35:09.416 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-24T14:35:09.416 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-24T14:35:10.191 INFO:teuthology.provision.fog.smithi133:Node is ready
2023-06-24T14:35:10.192 DEBUG:teuthology.orchestra.run.smithi133:> hostname
2023-06-24T14:35:10.236 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2023-06-24T14:35:10.237 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts
2023-06-24T14:35:10.281 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2023-06-24T14:35:10.281 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-06-24T14:35:10.401 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts
2023-06-24T14:35:10.415 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts
2023-06-24T14:35:10.468 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname
2023-06-24T14:35:10.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-06-24T14:35:10.576 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-06-24T14:35:10.621 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-06-24T14:35:10.621 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu"
2023-06-24T14:35:10.622 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04"
2023-06-24T14:35:10.622 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-06-24T14:35:10.622 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy
2023-06-24T14:35:10.622 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu
2023-06-24T14:35:10.623 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian
2023-06-24T14:35:10.623 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/"
2023-06-24T14:35:10.623 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-06-24T14:35:10.623 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-06-24T14:35:10.623 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-06-24T14:35:10.623 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy
2023-06-24T14:35:10.625 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 338, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi133's OS to be centos 8 but found ubuntu 22.04
2023-06-24T14:35:10.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-24T14:35:10.626 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-24T14:35:15.712 INFO:teuthology.nuke:Checking targets against current locks
2023-06-24T14:35:30.782 DEBUG:teuthology.nuke:shortname: smithi133
2023-06-24T14:35:30.782 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-24T14:35:40.815 DEBUG:teuthology.nuke:shortname: smithi202
2023-06-24T14:35:40.815 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-24T14:35:45.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315296', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:31:41.696064', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICq95xo71CXyFdVi43ZJ9CJqg+1Wdb+fH5gs6KUsRvg/'}
2023-06-24T14:35:50.861 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi202.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-23_21:02:01-rbd-reef-distro-default-smithi/7315296', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-24 14:31:41.694022', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKA7P/NvQsBpZKVGoLnzezVt/ws9Wiv+b7wmglr3KAYc/uyTcbSVukR+os6sNAjLemyEJRSkpT1Gv9mkaWVKZl3Ds2JOyHobMMqwn32e0pXdNSOZMIm8IxPob+FPbNbYCphAdLIWQu2l+6f3g9Ni5noA4TuM9/353mn3jnuc0jqYp9+IuxzNXLZQ/m34z0oiv5erBw6ccf6ym4CW5thC2HmYrrxdT1wKqzS9Am83GM1Zgd+IVpoHgJ0FAtTqpL5Iwn6t1u7Caiu1jhRo9giGpNYmURgjXDd37Ryb+FUsNalnOlSfq9IqDV45PxkXxe9ZKH/GI13PaQwtGO2KZZNcoaGD34AF3P2dH8Uk6/yepNaIs+L3BOPMp9vvw2Zb39Xj4VPfW3e40BSpQ2QruqncDE/fe2nnZXzkPVC77mSLwWyinP45HYVWE0kj2EIBdxyH6vwzrWgi4i8JtCwL9dKZDi6hOT2/oPeckBlDNC8rNwrqTBQuVjky2W11W0c60a+iU='}
2023-06-24T14:35:50.903 INFO:teuthology.orchestra.console:Power off smithi133
2023-06-24T14:35:50.903 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-24T14:35:50.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:35:50.944 INFO:teuthology.orchestra.console:Power off smithi202
2023-06-24T14:35:50.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-24T14:35:50.970 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:35:54.958 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:35:54.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:35:59.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:35:59.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi202.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:35:59.317 INFO:teuthology.orchestra.console:Power off for smithi202 completed
2023-06-24T14:36:04.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-24T14:36:09.486 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com
2023-06-24T14:36:09.561 INFO:teuthology.orchestra.console:Power off for smithi133 completed
2023-06-24T14:36:11.254 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2023-06-24T14:36:11.361 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 338, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi133's OS to be centos 8 but found ubuntu 22.04

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/requests/models.py", line 910, in json
    return complexjson.loads(self.text, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/simplejson/__init__.py", line 525, in loads
    return _default_decoder.decode(s)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/simplejson/decoder.py", line 370, in decode
    obj, end = self.raw_decode(s)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/simplejson/decoder.py", line 400, in raw_decode
    return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 237, in reimage
    check_for_reimage_failures_and_mark_down(targets)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 198, in check_for_reimage_failures_and_mark_down
    jobs = resp.json()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/lib/python3.8/site-packages/requests/models.py", line 917, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: [Errno Expecting value] <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>
: 0