2023-07-14T04:09:07.172 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb
2023-07-14T04:09:07.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T04:09:07.174 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T04:09:21.874 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff4b73265e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff4b85468b0>, signals=[15])
2023-07-14T04:09:21.876 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging
2023-07-14T04:09:21.877 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T04:09:21.877 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server
2023-07-14T04:09:21.903 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2023-07-14T04:09:21.903 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2023-07-14T04:09:21.904 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-07-14T04:09:21.906 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /host {"name": "smithi067"}
2023-07-14T04:09:26.519 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"}
2023-07-14T04:09:31.647 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T04:09:31.695 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T04:09:31.696 DEBUG:teuthology.provision.fog.smithi067:FOG request: PUT /host/172 {"imageID": 5}
2023-07-14T04:09:31.700 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-14T04:09:31.739 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-14T04:09:31.740 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 5}
2023-07-14T04:09:31.752 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of rhel 8.6
2023-07-14T04:09:31.752 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-14T04:09:36.758 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6
2023-07-14T04:09:36.758 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-07-14T04:09:41.817 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T04:09:46.822 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /tasktype {"name": "deploy"}
2023-07-14T04:09:51.866 DEBUG:teuthology.provision.fog.smithi067:FOG request: POST /host/172/task {"taskTypeID": 1}
2023-07-14T04:09:56.797 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1}
2023-07-14T04:09:56.866 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-07-14T04:10:01.874 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-14T04:10:16.979 INFO:teuthology.orchestra.console:Power off smithi112
2023-07-14T04:10:16.980 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:10:16.997 INFO:teuthology.orchestra.console:Power off smithi067
2023-07-14T04:10:16.998 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:10:22.010 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:27.028 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:27.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:32.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:32.140 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:37.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:37.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:37.464 INFO:teuthology.orchestra.console:Power off for smithi112 completed
2023-07-14T04:10:37.565 INFO:teuthology.orchestra.console:Power on smithi112
2023-07-14T04:10:37.565 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T04:10:37.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:41.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:42.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:42.490 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-07-14T04:10:42.592 INFO:teuthology.orchestra.console:Power on smithi067
2023-07-14T04:10:42.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-14T04:10:42.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:46.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:46.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:50.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:50.967 INFO:teuthology.orchestra.console:Power on for smithi067 completed
2023-07-14T04:10:51.068 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish
2023-07-14T04:10:51.068 DEBUG:teuthology.provision.fog.smithi067:FOG request: GET /task/active None
2023-07-14T04:10:51.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:10:51.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:10:54.197 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:10:56.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:00.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:11:05.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:08.272 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:11:10.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:14.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:11:19.281 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:22.352 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:11:24.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:28.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:11:33.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:36.432 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:11:38.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:42.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:11:43.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:45.488 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:11:48.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:51.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:11:53.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:11:54.548 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:11:58.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:12:00.038 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (16) after waiting for 60.0 seconds
2023-07-14T04:12:00.039 DEBUG:teuthology.provision.fog.smithi112:Canceling deploy task with ID None
2023-07-14T04:12:00.039 DEBUG:teuthology.provision.fog.smithi112:FOG request: DELETE /task/cancel {"id": None}
2023-07-14T04:12:05.049 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:12:10.104 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/console.py", line 243, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi112
2023-07-14T04:12:10.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-14T04:12:10.105 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-14T04:12:15.226 INFO:teuthology.nuke:Checking targets against current locks
2023-07-14T04:12:30.272 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67
2023-07-14T04:12:34.389 DEBUG:teuthology.nuke:shortname: smithi067
2023-07-14T04:12:34.389 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T04:12:34.427 DEBUG:teuthology.nuke:shortname: smithi112
2023-07-14T04:12:34.427 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-14T04:12:39.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-14T04:12:44.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336938', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:08:51.334602', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-14T04:12:49.475 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-13_23:12:00-rados-wip-yuri2-testing-2023-07-13-1236-distro-default-smithi/7336938', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-14 04:08:51.336132', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAOq19AsQraqDhfRTwawff+3QB1379Ouok9CTNbl/YH56pRVZTOMXeZXo5tCERWlbw4ubLEeA8mTstaKyTUMsjw='}
2023-07-14T04:12:51.268 ERROR:teuthology.orchestra.connection:Error authenticating with smithi067.front.sepia.ceph.com: Authentication failed.
2023-07-14T04:12:51.270 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-14T04:12:51.272 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-14T04:12:51.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:51.295 INFO:teuthology.orchestra.console:Power off smithi067
2023-07-14T04:12:51.296 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:12:51.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:12:51.352 INFO:teuthology.orchestra.console:Power off smithi112
2023-07-14T04:12:51.353 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-14T04:12:51.375 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:12:52.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:53.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:54.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:55.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:55.366 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:12:55.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:12:56.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:57.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:12:58.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-14T04:13:00.479 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:00.509 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:05.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:05.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:10.702 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:10.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:15.813 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:15.839 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:16.051 INFO:teuthology.orchestra.console:Power off for smithi112 completed
2023-07-14T04:13:16.206 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2023-07-14T04:13:20.927 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:26.038 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:31.149 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:36.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:41.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:46.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:51.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:56.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-14T04:13:56.921 INFO:teuthology.orchestra.console:Power off for smithi067 completed
2023-07-14T04:14:01.050 INFO:teuthology.lock.ops:unlocked: smithi067.front.sepia.ceph.com
2023-07-14T04:14:01.254 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_073e6eb1231451146b4a01d0b85b4f490f71d266/teuthology/orchestra/console.py", line 243, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi112