2023-09-21T14:58:43.304 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-21T14:58:43.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T14:58:43.428 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2bc758ecd0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2bc8095670>, signals=[15])
2023-09-21T14:58:43.430 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-09-21T14:58:43.431 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-09-21T14:58:43.431 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-09-21T14:58:43.455 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-09-21T14:58:43.531 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-21T14:58:43.573 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-21T14:58:43.573 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 5}
2023-09-21T14:58:43.619 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6
2023-09-21T14:58:43.619 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-09-21T14:58:43.716 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-09-21T14:58:43.767 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-09-21T14:58:43.821 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-09-21T14:58:43.987 INFO:teuthology.orchestra.console.smithi107:Power off
2023-09-21T14:58:43.988 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:59:04.061 DEBUG:teuthology.orchestra.console.smithi107:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:59:04.065 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:59:24.137 DEBUG:teuthology.orchestra.console.smithi107:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:59:24.139 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T14:59:44.209 DEBUG:teuthology.orchestra.console.smithi107:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T14:59:44.210 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:59:45.220 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T14:59:49.223 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:59:50.336 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T14:59:54.338 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T14:59:55.446 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T14:59:59.450 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:00.560 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:04.562 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:05.670 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:09.674 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:10.784 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:14.789 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:15.898 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:19.906 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:21.014 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:25.018 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:26.126 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:30.130 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:31.238 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:35.242 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:36.350 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:40.354 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:41.463 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:45.465 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:46.574 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:50.578 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:51.687 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:55.690 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:00:56.801 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:00:56.802 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T15:00:56.803 ERROR:teuthology.orchestra.console.smithi107:Failed to power off
2023-09-21T15:00:56.803 INFO:teuthology.orchestra.console.smithi107:Power on
2023-09-21T15:00:56.804 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T15:01:16.877 DEBUG:teuthology.orchestra.console.smithi107:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T15:01:16.879 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T15:01:36.949 DEBUG:teuthology.orchestra.console.smithi107:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T15:01:36.951 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-21T15:01:57.021 DEBUG:teuthology.orchestra.console.smithi107:power on output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T15:01:57.023 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:01:58.033 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:02.038 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:03.146 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:07.150 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:08.259 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:12.262 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:13.371 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:17.376 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:18.486 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:22.490 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:23.599 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:27.602 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:28.713 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:32.718 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:33.826 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:37.834 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:38.944 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:42.948 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:44.058 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:48.062 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:49.171 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:53.174 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:54.284 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:02:58.286 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:02:59.395 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:03:03.400 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:03:04.508 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:03:08.514 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:03:09.623 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:03:09.624 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T15:03:09.625 DEBUG:teuthology.provision.fog.smithi107:Canceling deploy task with ID 500170
2023-09-21T15:03:09.625 DEBUG:teuthology.provision.fog.smithi107:FOG request: DELETE /task/cancel {"id": 500170}
2023-09-21T15:03:09.684 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi107
2023-09-21T15:03:09.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-21T15:03:09.832 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=024aff1d20cc4d059a4a58b262b4f9e5
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi107
2023-09-21T15:03:09.834 INFO:teuthology.nuke:Checking targets against current locks
2023-09-21T15:03:09.893 DEBUG:teuthology.nuke:shortname: smithi107
2023-09-21T15:03:09.893 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-21T15:03:09.913 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/svelar-2023-09-20_07:59:56-rados-wip-svelar-testing-1-2023-09-20-1125-distro-default-smithi/7398891', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 14:58:41.339121', 'locked_by': 'scheduled_svelar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-21T15:03:09.967 INFO:teuthology.orchestra.console.smithi107:Power off
2023-09-21T15:03:09.968 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T15:03:30.037 DEBUG:teuthology.orchestra.console.smithi107:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T15:03:30.039 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T15:03:50.109 DEBUG:teuthology.orchestra.console.smithi107:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T15:03:50.111 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-21T15:04:10.181 DEBUG:teuthology.orchestra.console.smithi107:power off output: Error: Unable to establish IPMI v2 / RMCP+ session
2023-09-21T15:04:10.196 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:11.206 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:15.207 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:16.321 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:20.326 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:21.436 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:25.438 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:26.550 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:30.554 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:31.665 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:35.673 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:36.786 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:40.790 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:41.899 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:45.902 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:47.012 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:51.014 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:52.124 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:04:56.129 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:04:57.242 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:05:01.246 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:05:02.357 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:05:06.362 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:05:07.473 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:05:11.478 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:05:12.592 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:05:16.594 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:05:17.703 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:05:21.706 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-21T15:05:22.817 DEBUG:teuthology.orchestra.console.smithi107:check power output: 
2023-09-21T15:05:22.818 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-09-21T15:05:22.818 ERROR:teuthology.orchestra.console.smithi107:Failed to power off
2023-09-21T15:05:22.987 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2023-09-21T15:05:23.110 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/console.py", line 252, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi107