2023-04-10T15:49:26.999 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae
2023-04-10T15:49:27.138 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging
2023-04-10T15:49:27.139 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server
2023-04-10T15:49:27.139 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-04-10T15:49:27.162 INFO:teuthology.lock.ops:Node 'smithi023.front.sepia.ceph.com' reimaging is complete
2023-04-10T15:49:27.163 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging
2023-04-10T15:49:27.163 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server
2023-04-10T15:49:27.163 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server
2023-04-10T15:49:27.187 INFO:teuthology.lock.ops:Node 'smithi145.front.sepia.ceph.com' reimaging is complete
2023-04-10T15:49:27.309 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream
2023-04-10T15:49:27.340 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 8.stream
2023-04-10T15:49:27.547 INFO:teuthology.orchestra.console:Power off smithi023
2023-04-10T15:49:27.564 INFO:teuthology.orchestra.console:Power off smithi145
2023-04-10T15:49:27.705 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2023-04-10T15:49:27.806 INFO:teuthology.orchestra.console:Power on smithi145
2023-04-10T15:49:35.919 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2023-04-10T15:49:36.020 INFO:teuthology.orchestra.console:Power on smithi023
2023-04-10T15:49:36.170 INFO:teuthology.orchestra.console:Power on for smithi145 completed
2023-04-10T15:49:36.271 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish
2023-04-10T15:49:44.391 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2023-04-10T15:49:44.492 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2023-04-10T16:01:28.965 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:01:38.021 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:01:47.077 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:01:56.133 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:02:05.193 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:02:14.277 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:02:23.333 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:02:32.389 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:02:41.445 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-04-10T16:03:47.461 WARNING:teuthology.provision.fog:timed out
2023-04-10T16:03:53.839 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-04-10T16:03:54.125 INFO:teuthology.provision.fog.smithi023:Node is ready
2023-04-10T16:03:54.144 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2023-04-10T16:03:54.204 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2023-04-10T16:03:54.561 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2023-04-10T16:04:34.916 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 226, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/provision/fog.py", line 255, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/contextutil.py", line 135, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 900 seconds
2023-04-10T16:04:34.987 INFO:teuthology.nuke:Checking targets against current locks
2023-04-10T16:04:35.044 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-10T16:04:35.070 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-04-10T16:04:35.129 INFO:teuthology.orchestra.console:Power off smithi023
2023-04-10T16:04:35.168 INFO:teuthology.orchestra.console:Power off smithi145
2023-04-10T16:04:43.531 INFO:teuthology.orchestra.console:Power off for smithi145 completed
2023-04-10T16:04:43.684 INFO:teuthology.lock.ops:unlocked: smithi145.front.sepia.ceph.com
2023-04-10T16:04:47.621 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2023-04-10T16:04:47.776 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com
2023-04-10T16:04:48.022 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 56, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 226, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/provision/fog.py", line 255, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/contextutil.py", line 135, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 900 seconds