2023-02-23T17:45:43.869 INFO:root:teuthology version: 0.0.1.dev41+gfbbadb5
2023-02-23T17:45:44.004 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2023-02-23T17:45:44.005 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2023-02-23T17:45:44.005 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2023-02-23T17:45:44.020 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete
2023-02-23T17:45:44.020 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging
2023-02-23T17:45:44.020 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server
2023-02-23T17:45:44.020 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server
2023-02-23T17:45:44.036 INFO:teuthology.lock.ops:Node 'smithi046.front.sepia.ceph.com' reimaging is complete
2023-02-23T17:45:44.036 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging
2023-02-23T17:45:44.036 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server
2023-02-23T17:45:44.036 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server
2023-02-23T17:45:44.050 INFO:teuthology.lock.ops:Node 'smithi186.front.sepia.ceph.com' reimaging is complete
2023-02-23T17:45:44.172 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of rhel 8.6
2023-02-23T17:45:44.176 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.6
2023-02-23T17:45:44.184 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6
2023-02-23T17:45:44.397 INFO:teuthology.orchestra.console:Power off smithi045
2023-02-23T17:45:44.436 INFO:teuthology.orchestra.console:Power off smithi046
2023-02-23T17:45:44.451 INFO:teuthology.orchestra.console:Power off smithi186
2023-02-23T17:45:44.559 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2023-02-23T17:45:44.581 INFO:teuthology.orchestra.console:Power off for smithi046 completed
2023-02-23T17:45:44.592 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2023-02-23T17:45:44.661 INFO:teuthology.orchestra.console:Power on smithi045
2023-02-23T17:45:44.690 INFO:teuthology.orchestra.console:Power on smithi046
2023-02-23T17:45:44.698 INFO:teuthology.orchestra.console:Power on smithi186
2023-02-23T17:45:48.941 INFO:teuthology.orchestra.console:Power on for smithi046 completed
2023-02-23T17:45:49.042 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish
2023-02-23T17:45:53.059 INFO:teuthology.orchestra.console:Power on for smithi186 completed
2023-02-23T17:45:53.115 INFO:teuthology.orchestra.console:Power on for smithi045 completed
2023-02-23T17:45:53.160 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish
2023-02-23T17:45:53.215 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2023-02-23T17:49:57.637 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-02-23T17:50:06.693 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-02-23T17:50:15.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-02-23T17:50:24.805 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-02-23T17:50:33.865 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.186
2023-02-23T17:51:39.873 WARNING:teuthology.provision.fog:timed out
2023-02-23T17:51:46.221 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-23T17:51:46.483 INFO:teuthology.provision.fog.smithi186:Node is ready
2023-02-23T17:51:46.501 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186
2023-02-23T17:51:46.558 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186
2023-02-23T17:51:46.902 INFO:teuthology.provision.fog.smithi186:Deploy complete!
2023-02-23T17:54:47.429 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-02-23T17:54:56.489 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-02-23T17:55:05.573 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45
2023-02-23T17:56:11.577 WARNING:teuthology.provision.fog:timed out
2023-02-23T17:56:17.921 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-23T17:56:18.227 INFO:teuthology.provision.fog.smithi045:Node is ready
2023-02-23T17:56:18.246 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2023-02-23T17:56:18.306 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2023-02-23T17:56:18.686 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2023-02-23T18:01:12.793 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 209, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/provision/fog.py", line 255, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 900 seconds
2023-02-23T18:01:12.861 INFO:teuthology.nuke:Checking targets against current locks
2023-02-23T18:01:12.904 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-23T18:01:12.932 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-23T18:01:12.950 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-23T18:01:12.985 INFO:teuthology.orchestra.console:Power off smithi045
2023-02-23T18:01:13.030 INFO:teuthology.orchestra.console:Power off smithi046
2023-02-23T18:01:13.045 INFO:teuthology.orchestra.console:Power off smithi186
2023-02-23T18:01:21.392 INFO:teuthology.orchestra.console:Power off for smithi045 completed
2023-02-23T18:01:21.410 INFO:teuthology.orchestra.console:Power off for smithi186 completed
2023-02-23T18:01:21.533 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com
2023-02-23T18:01:21.551 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com
2023-02-23T18:01:25.511 INFO:teuthology.orchestra.console:Power off for smithi046 completed
2023-02-23T18:01:25.652 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com
2023-02-23T18:01:25.938 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/__init__.py", line 63, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 52, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 209, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/provision/fog.py", line 255, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 900 seconds