2022-11-28T00:10:56.164 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf
2022-11-28T00:11:25.658 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging
2022-11-28T00:11:25.660 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server
2022-11-28T00:11:25.660 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server
2022-11-28T00:11:30.693 INFO:teuthology.lock.ops:Node 'smithi039.front.sepia.ceph.com' reimaging is complete
2022-11-28T00:11:30.694 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging
2022-11-28T00:11:30.694 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server
2022-11-28T00:11:30.694 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server
2022-11-28T00:11:30.721 INFO:teuthology.lock.ops:Node 'smithi064.front.sepia.ceph.com' reimaging is complete
2022-11-28T00:11:30.721 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2022-11-28T00:11:30.722 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2022-11-28T00:11:30.722 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2022-11-28T00:11:30.747 INFO:teuthology.lock.ops:Node 'smithi155.front.sepia.ceph.com' reimaging is complete
2022-11-28T00:11:30.917 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.6
2022-11-28T00:11:30.944 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of rhel 8.6
2022-11-28T00:11:30.970 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.6
2022-11-28T00:12:01.212 INFO:teuthology.orchestra.console:Power off smithi039
2022-11-28T00:12:01.234 INFO:teuthology.orchestra.console:Power off smithi064
2022-11-28T00:12:06.326 INFO:teuthology.orchestra.console:Power off smithi155
2022-11-28T00:12:25.575 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2022-11-28T00:12:25.676 INFO:teuthology.orchestra.console:Power on smithi039
2022-11-28T00:12:31.901 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2022-11-28T00:12:32.002 INFO:teuthology.orchestra.console:Power on smithi155
2022-11-28T00:12:47.283 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2022-11-28T00:12:47.384 INFO:teuthology.orchestra.console:Power on smithi064
2022-11-28T00:12:50.585 INFO:teuthology.orchestra.console:Power on for smithi155 completed
2022-11-28T00:12:50.686 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2022-11-28T00:14:03.674 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (15) after waiting for 60.0 seconds
2022-11-28T00:14:06.913 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/dispatcher/supervisor.py", line 209, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/orchestra/console.py", line 243, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi039
2022-11-28T00:14:11.660 INFO:teuthology.nuke:Checking targets against current locks
2022-11-28T00:14:35.488 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-11-28T00:14:35.528 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-11-28T00:14:35.633 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-11-28T00:14:35.660 ERROR:teuthology.orchestra.connection:Error authenticating with smithi155.front.sepia.ceph.com: Authentication failed.
2022-11-28T00:14:35.685 INFO:teuthology.orchestra.console:Power off smithi039
2022-11-28T00:14:35.745 INFO:teuthology.orchestra.console:Power off smithi064
2022-11-28T00:14:35.789 INFO:teuthology.orchestra.console:Power off smithi155
2022-11-28T00:14:41.757 ERROR:teuthology.orchestra.connection:Error authenticating with smithi155.front.sepia.ceph.com: Authentication failed.
2022-11-28T00:14:41.890 INFO:teuthology.orchestra.console:Power on for smithi064 completed
2022-11-28T00:14:41.992 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish
2022-11-28T00:14:52.216 INFO:teuthology.orchestra.console:Power off for smithi064 completed
2022-11-28T00:14:52.220 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2022-11-28T00:15:07.329 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com
2022-11-28T00:15:07.331 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com
2022-11-28T00:15:07.394 INFO:teuthology.orchestra.console:Power off for smithi039 completed
2022-11-28T00:15:07.543 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com
2022-11-28T00:15:07.913 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/dispatcher/supervisor.py", line 52, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/dispatcher/supervisor.py", line 209, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_4da97cf64e542f347ec47b7bdbe5eca99759f9b7/teuthology/orchestra/console.py", line 243, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi039