2024-04-08T06:15:01.642 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-08T06:15:01.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:15:01.801 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f353ca05f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f353da66c10>, signals=[15])
2024-04-08T06:15:01.802 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging
2024-04-08T06:15:01.802 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T06:15:01.802 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2024-04-08T06:15:01.824 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2024-04-08T06:15:01.824 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2024-04-08T06:15:01.824 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2024-04-08T06:15:01.938 DEBUG:teuthology.provision.fog.smithi106:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T06:15:01.954 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_9.stream (ID 10)
2024-04-08T06:15:01.989 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of centos 9.stream
2024-04-08T06:15:01.995 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 9.stream
2024-04-08T06:15:02.281 INFO:teuthology.orchestra.console.smithi178:Power off
2024-04-08T06:15:02.281 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T06:15:02.296 INFO:teuthology.orchestra.console.smithi106:Power off
2024-04-08T06:15:02.297 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T06:15:02.305 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2024-04-08T06:15:02.305 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:02.317 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off
2024-04-08T06:15:02.317 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:02.326 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-08T06:15:02.338 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-08T06:15:02.427 INFO:teuthology.orchestra.console.smithi178:Power off completed
2024-04-08T06:15:02.439 INFO:teuthology.orchestra.console.smithi106:Power off completed
2024-04-08T06:15:02.528 INFO:teuthology.orchestra.console.smithi178:Power on
2024-04-08T06:15:02.528 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T06:15:02.540 INFO:teuthology.orchestra.console.smithi106:Power on
2024-04-08T06:15:02.540 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-08T06:15:02.552 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On
2024-04-08T06:15:02.553 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:02.565 DEBUG:teuthology.orchestra.console.smithi106:power on output: Chassis Power Control: Up/On
2024-04-08T06:15:02.565 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:02.578 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-08T06:15:02.586 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-08T06:15:06.582 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:06.589 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:06.691 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-08T06:15:06.697 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-08T06:15:10.696 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:10.703 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:15:10.806 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-08T06:15:10.865 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-08T06:15:10.907 INFO:teuthology.orchestra.console.smithi178:Power on completed
2024-04-08T06:15:10.966 INFO:teuthology.orchestra.console.smithi106:Power on completed
2024-04-08T06:15:11.008 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2024-04-08T06:15:11.067 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2024-04-08T06:15:26.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:15:29.250 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:15:35.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:15:38.334 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:15:44.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:15:47.394 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:15:53.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:15:56.478 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:02.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:05.538 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:11.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:14.590 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:20.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:23.678 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:29.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:32.738 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:38.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:41.826 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:47.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:50.910 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:16:56.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:16:59.970 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:17:05.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:17:24.511 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:17:30.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:17:33.566 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2024-04-08T06:17:39.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:17:39.712 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T06:17:42.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:17:43.845 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T06:17:45.154 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-08T06:17:50.938 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T06:17:51.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:17:54.206 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-08T06:18:00.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:18:01.031 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T06:18:03.262 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-08T06:18:09.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:18:12.318 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-08T06:18:14.169 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T06:18:18.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:18:21.374 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-08T06:18:27.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:18:30.302 ERROR:teuthology.orchestra.connection:Error authenticating with smithi178.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-08T06:18:30.430 WARNING:teuthology.provision.fog.smithi106:[Errno None] Unable to connect to port 22 on 172.21.15.106
2024-04-08T06:18:36.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:19:36.434 WARNING:teuthology.provision.fog.smithi106:timed out
2024-04-08T06:19:42.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:19:42.629 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T06:19:42.629 DEBUG:teuthology.orchestra.run.smithi106:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T06:19:42.967 INFO:teuthology.provision.fog.smithi106:Node is ready
2024-04-08T06:19:42.967 DEBUG:teuthology.orchestra.run.smithi106:> hostname
2024-04-08T06:19:42.984 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com
2024-04-08T06:19:42.984 DEBUG:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts
2024-04-08T06:19:43.042 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106
2024-04-08T06:19:43.042 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-04-08T06:19:43.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts
2024-04-08T06:19:43.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts
2024-04-08T06:19:43.266 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname
2024-04-08T06:19:43.335 DEBUG:teuthology.orchestra.run.smithi106:> sudo hostname smithi106
2024-04-08T06:19:43.404 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release
2024-04-08T06:19:43.459 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="CentOS Stream"
2024-04-08T06:19:43.459 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="9"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:ID="centos"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="rhel fedora"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="9"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el9"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:LOGO="fedora-logo-icon"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://centos.org/"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-08T06:19:43.460 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T06:19:43.461 INFO:teuthology.provision.fog.smithi106:Deploy complete!
2024-04-08T06:19:43.462 DEBUG:teuthology.parallel:result is None
2024-04-08T06:19:49.306 WARNING:teuthology.provision.fog.smithi178:timed out
2024-04-08T06:19:55.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:20:55.309 WARNING:teuthology.provision.fog.smithi178:timed out
2024-04-08T06:21:01.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-08T06:21:01.388 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-08T06:21:01.388 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-08T06:21:01.415 INFO:teuthology.provision.fog.smithi178:Node is ready
2024-04-08T06:21:01.415 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2024-04-08T06:21:01.474 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178
2024-04-08T06:21:01.475 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178 /etc/hosts
2024-04-08T06:21:01.535 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2024-04-08T06:21:01.536 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2024-04-08T06:21:01.607 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178/smithi178/g' /etc/hosts
2024-04-08T06:21:01.676 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2024-04-08T06:21:01.744 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178/smithi178/g' /etc/hostname
2024-04-08T06:21:01.811 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2024-04-08T06:21:01.879 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-04-08T06:21:01.937 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2024-04-08T06:21:01.938 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-08T06:21:01.938 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-08T06:21:01.938 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-08T06:21:01.939 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi178's OS to be centos 9 but found centos 8
2024-04-08T06:21:01.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-08T06:21:02.229 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=eb30566bd65544b5b4d6191e39161732
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi178's OS to be centos 9 but found centos 8
2024-04-08T06:21:02.231 INFO:teuthology.nuke:Checking targets against current locks
2024-04-08T06:21:02.291 DEBUG:teuthology.nuke:shortname: smithi106
2024-04-08T06:21:02.291 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-08T06:21:02.313 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-07_21:00:03-rados-squid-distro-default-smithi/7644496', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-08 06:15:00.574944', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBUKsMG9joC1DEvhL/2ZHfCOGjEzZjtcoacrjXlIOiW5NmroMotZVH0qe0bma9aExx27IbfO1XGXOPVemVL6oGw='}
2024-04-08T06:21:02.317 DEBUG:teuthology.nuke:shortname: smithi178
2024-04-08T06:21:02.317 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-04-08T06:21:02.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-07_21:00:03-rados-squid-distro-default-smithi/7644497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-08 06:15:21.024922', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDwpjcO2lVnDF4CD52y+Pala106raVdUFm5ghX4Mp8fGH2QY7xUofO7UwYoe5BGBB0X+7v3qj2BfhXlMBuSEGCo='}
2024-04-08T06:21:02.368 INFO:teuthology.orchestra.console.smithi106:Power off
2024-04-08T06:21:02.369 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T06:21:02.393 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off
2024-04-08T06:21:02.394 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:02.408 INFO:teuthology.orchestra.console.smithi178:Power off
2024-04-08T06:21:02.409 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-08T06:21:02.418 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-08T06:21:02.432 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2024-04-08T06:21:02.432 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:02.456 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-08T06:21:06.420 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:06.457 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:06.531 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-08T06:21:06.567 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2024-04-08T06:21:10.532 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:10.568 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:10.645 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on
2024-04-08T06:21:10.677 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2024-04-08T06:21:10.778 INFO:teuthology.orchestra.console.smithi178:Power off completed
2024-04-08T06:21:10.926 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com
2024-04-08T06:21:14.646 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-08T06:21:14.757 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off
2024-04-08T06:21:14.859 INFO:teuthology.orchestra.console.smithi106:Power off completed
2024-04-08T06:21:15.019 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com
2024-04-08T06:21:15.296 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/dispatcher/supervisor.py", line 232, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 92, in create
    self._verify_installed_os()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/provision/fog.py", line 347, in _verify_installed_os
    raise RuntimeError(
RuntimeError: Expected smithi178's OS to be centos 9 but found centos 8