2023-08-16T02:03:16.737 INFO:root:teuthology version: 0.0.1.dev183+g5435569
2023-08-16T02:03:16.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T02:03:16.890 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9cdecff760>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9cde224f70>, signals=[15])
2023-08-16T02:03:16.891 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2023-08-16T02:03:16.892 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2023-08-16T02:03:16.892 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-08-16T02:03:16.918 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging
2023-08-16T02:03:16.918 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server
2023-08-16T02:03:16.918 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server
2023-08-16T02:03:16.920 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"}
2023-08-16T02:03:16.942 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"}
2023-08-16T02:03:16.992 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-16T02:03:17.009 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-16T02:03:17.028 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_8.stream (ID 3)
2023-08-16T02:03:17.028 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 3}
2023-08-16T02:03:17.052 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_centos_8.stream (ID 3)
2023-08-16T02:03:17.053 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 3}
2023-08-16T02:03:17.074 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream
2023-08-16T02:03:17.074 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-16T02:03:17.096 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of centos 8.stream
2023-08-16T02:03:17.096 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-08-16T02:03:17.142 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"}
2023-08-16T02:03:17.181 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"}
2023-08-16T02:03:17.192 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1}
2023-08-16T02:03:17.223 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1}
2023-08-16T02:03:17.241 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-16T02:03:17.284 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-08-16T02:03:27.334 INFO:teuthology.orchestra.console.smithi115:Power off
2023-08-16T02:03:27.335 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T02:03:27.359 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-08-16T02:03:27.362 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:37.385 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-08-16T02:03:37.414 INFO:teuthology.orchestra.console.smithi140:Power off
2023-08-16T02:03:37.415 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T02:03:37.487 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-08-16T02:03:37.588 INFO:teuthology.orchestra.console.smithi115:Power on
2023-08-16T02:03:37.588 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-16T02:03:42.438 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-08-16T02:03:42.439 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:42.610 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2023-08-16T02:03:42.611 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:43.450 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:03:43.620 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:03:47.452 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:47.622 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:48.563 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:03:48.734 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:03:52.566 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:52.735 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:53.678 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:03:53.847 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:03:57.680 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:57.848 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:03:58.791 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:03:58.961 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:04:02.796 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:02.962 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:03.073 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-08-16T02:04:03.175 INFO:teuthology.orchestra.console.smithi115:Power on completed
2023-08-16T02:04:03.276 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2023-08-16T02:04:03.276 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-16T02:04:03.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:04:08.346 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-08-16T02:04:08.446 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-08-16T02:04:08.547 INFO:teuthology.orchestra.console.smithi140:Power on
2023-08-16T02:04:08.548 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-16T02:04:11.409 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-16T02:04:13.578 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On
2023-08-16T02:04:13.578 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:14.588 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:17.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:04:22.420 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:23.530 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:25.488 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-16T02:04:27.531 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:28.642 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:31.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:04:36.497 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:37.607 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:39.568 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-16T02:04:41.608 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:42.718 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:45.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:04:50.577 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:51.686 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:53.648 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-16T02:04:55.688 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:04:56.798 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:04:59.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:05:00.800 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:05:01.912 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:05:02.710 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-16T02:05:05.916 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:05:07.025 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:05:08.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:05:11.027 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:05:12.139 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:05:16.144 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:05:16.255 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on
2023-08-16T02:05:16.356 INFO:teuthology.orchestra.console.smithi140:Power on completed
2023-08-16T02:05:16.457 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish
2023-08-16T02:05:16.458 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None
2023-08-16T02:05:18.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:05:21.616 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-08-16T02:05:27.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:05:35.696 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-08-16T02:05:41.069 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-16T02:05:41.070 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-16T02:05:41.471 INFO:teuthology.provision.fog.smithi115:Node is ready
2023-08-16T02:05:41.471 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2023-08-16T02:05:41.487 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2023-08-16T02:05:41.487 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2023-08-16T02:05:41.543 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2023-08-16T02:05:41.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-08-16T02:05:41.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:05:46.702 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2023-08-16T02:05:46.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2023-08-16T02:05:46.809 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2023-08-16T02:05:46.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-08-16T02:05:46.955 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-08-16T02:05:47.010 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Red Hat Enterprise Linux"
2023-08-16T02:05:47.011 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8.6 (Ootpa)"
2023-08-16T02:05:47.011 INFO:teuthology.orchestra.run.smithi115.stdout:ID="rhel"
2023-08-16T02:05:47.011 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="fedora"
2023-08-16T02:05:47.011 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8.6"
2023-08-16T02:05:47.011 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2023-08-16T02:05:47.011 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.redhat.com/"
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:
2023-08-16T02:05:47.012 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-16T02:05:47.013 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-16T02:05:47.013 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-16T02:05:47.013 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-16T02:05:47.016 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi115's OS to be centos 8 but found rhel 8.6
2023-08-16T02:05:47.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-16T02:05:52.170 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a7aa7e52c5d449d688c18defe9ef7308
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi115's OS to be centos 8 but found rhel 8.6
2023-08-16T02:05:52.173 INFO:teuthology.nuke:Checking targets against current locks
2023-08-16T02:05:58.626 DEBUG:teuthology.nuke:shortname: smithi115
2023-08-16T02:05:58.627 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-16T02:05:58.649 DEBUG:teuthology.nuke:shortname: smithi140
2023-08-16T02:05:58.649 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-16T02:05:58.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_18:58:56-rados-wip-yuri3-testing-2023-08-15-0955-distro-default-smithi/7369252', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 02:03:15.902079', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDR9sRym4ARaS5ZZedwATaXePfRjSajzVWBWEWQYXrTp+y3xYktQsvYwyU6FvdO1SA/WJBxwT2njEcpffMuPaZhnwrEl+1Bxa8WtQ3Le3VapY0jXVUnXgJGrkIrdVFvOGyoOwMKey9uUXwwuyF3ZS8kHDYALFyiz2PkxnNmBWxkVXzrF7eAkqbj1Q4BarjUt0v7SvfDheiV0QP790FzyfCxTx+SviVRwteO/7Rnws2b9+D4RBFgS/+x2udEsKQxN/T7SH/hiRFphQIHgztOa0irZ7cb1T9Qfw8SWApzQMolrmyTEgKBlxC2ufkMuDB5BxrRXkoj1CyGGe2zZ+y3W7e17axYAOMQEWLskk0IXW0yoXYRN57o4yKx6oMuWY2u9HKebp51wjfWOWoXA+yfa8ynUb9Fzz9hiI2m8SGRufWaKfWnVa3olFEI1WjXRj8ITeSZhiy8lJutilQWEdcmA6a4Diu1kpjr9pzyfrwOpd/JdLxqK9brRts4+fv17tpBq2U='}
2023-08-16T02:06:03.686 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_18:58:56-rados-wip-yuri3-testing-2023-08-15-0955-distro-default-smithi/7369252', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 02:03:15.900608', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEkzQ7EH4Xg28uEXplBC8VwWgTcEpNmaNiWWdmzpjKZCd24cPwkawMk4WyAEU3yoPnHO4+WJcnBt2RtHpttUDoymlnngyQBKAEbiR1LO51cbLkPBlHQ3AIF/cKdjV/WihpnYJOoMVPqi4DwJ9ldRoldBLvxqyP5errt9ErXfH04mVq4eeWkANF1tCIxBM3LPq2OAGyUU5F4tsVzXb+trLGmU38nG6i/M/lr9qsJWMwmsL8Ixu5bd2KYTJiavyDqTNAjO1B32UBx2E1OKTlxhjEL5uNIIS9owWwV6J3l845kyrDwv8kVZpilPnIZ+MwCH7rlX/gv5e2qVA3RmlPFi3qfglPkO5Mjh7Jz/QuoTkuRbhB127rW8tYDMbbjJE3R2dyHAoe1HV04y/30hsjXI6OHSBc8xzMoTaalDvHJirVoJe/Gzt1uvE+sADTBPhtl3DT3szOacsLde/5LNycco1TulupiTHTU1kq6NRZGe7L1T0hqUG2+/1Qrv1cXQC2cOk='}
2023-08-16T02:06:08.725 INFO:teuthology.orchestra.console.smithi115:Power off
2023-08-16T02:06:08.726 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T02:06:13.752 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-08-16T02:06:13.753 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:13.776 INFO:teuthology.orchestra.console.smithi140:Power off
2023-08-16T02:06:13.777 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-16T02:06:14.763 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:06:18.766 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:18.804 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off
2023-08-16T02:06:18.805 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:18.878 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-08-16T02:06:19.816 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:06:22.882 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:23.818 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:23.994 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:06:24.928 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:06:27.996 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:28.931 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:29.106 DEBUG:teuthology.orchestra.console.smithi115:check power output: 
2023-08-16T02:06:30.042 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:06:33.108 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:33.221 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-08-16T02:06:33.322 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-08-16T02:06:38.433 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:43.499 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com
2023-08-16T02:06:44.475 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:06:46.703 WARNING:teuthology.provision.fog.smithi140:timed out
2023-08-16T02:06:48.478 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:49.593 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:06:52.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:06:53.596 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:54.708 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:06:55.764 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-08-16T02:06:58.712 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:06:59.823 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:07:01.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:07:03.825 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:07:04.848 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-08-16T02:07:04.936 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:07:08.940 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:07:10.051 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:07:10.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:07:15.857 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:07:16.968 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:07:18.928 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-08-16T02:07:20.972 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:07:22.084 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:07:24.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:07:29.937 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:07:31.047 DEBUG:teuthology.orchestra.console.smithi140:check power output: 
2023-08-16T02:07:33.012 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140
2023-08-16T02:07:35.049 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-16T02:07:35.161 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off
2023-08-16T02:07:35.262 INFO:teuthology.orchestra.console.smithi140:Power off completed
2023-08-16T02:07:41.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-16T02:07:51.358 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com
2023-08-16T02:07:53.752 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 348, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi115's OS to be centos 8 but found rhel 8.6