2022-12-19T21:27:13.091 INFO:root:teuthology version: 0.0.1.dev18+g19d18db
2022-12-19T21:27:13.306 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging
2022-12-19T21:27:13.306 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server
2022-12-19T21:27:13.306 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2022-12-19T21:27:13.326 INFO:teuthology.lock.ops:Node 'smithi005.front.sepia.ceph.com' reimaging is complete
2022-12-19T21:27:13.326 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2022-12-19T21:27:13.326 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2022-12-19T21:27:13.327 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2022-12-19T21:27:13.346 INFO:teuthology.lock.ops:Node 'smithi099.front.sepia.ceph.com' reimaging is complete
2022-12-19T21:27:13.346 INFO:teuthology.lock.ops:Start node 'smithi106.front.sepia.ceph.com' reimaging
2022-12-19T21:27:13.346 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: reset os type and version on server
2022-12-19T21:27:13.346 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server
2022-12-19T21:27:13.365 INFO:teuthology.lock.ops:Node 'smithi106.front.sepia.ceph.com' reimaging is complete
2022-12-19T21:27:13.365 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2022-12-19T21:27:13.366 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2022-12-19T21:27:13.366 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2022-12-19T21:27:13.384 INFO:teuthology.lock.ops:Node 'smithi154.front.sepia.ceph.com' reimaging is complete
2022-12-19T21:27:13.384 INFO:teuthology.lock.ops:Start node 'smithi168.front.sepia.ceph.com' reimaging
2022-12-19T21:27:13.385 INFO:teuthology.lock.ops:Updating [smithi168.front.sepia.ceph.com]: reset os type and version on server
2022-12-19T21:27:13.385 INFO:teuthology.lock.ops:Updating smithi168.front.sepia.ceph.com on lock server
2022-12-19T21:27:13.402 INFO:teuthology.lock.ops:Node 'smithi168.front.sepia.ceph.com' reimaging is complete
2022-12-19T21:27:13.494 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of ubuntu 18.04
2022-12-19T21:27:13.501 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of ubuntu 18.04
2022-12-19T21:27:13.519 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of ubuntu 18.04
2022-12-19T21:27:13.557 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of ubuntu 18.04
2022-12-19T21:27:13.566 INFO:teuthology.provision.fog.smithi168:Scheduling deploy of ubuntu 18.04
2022-12-19T21:27:13.832 INFO:teuthology.orchestra.console:Power off smithi005
2022-12-19T21:27:13.851 INFO:teuthology.orchestra.console:Power off smithi106
2022-12-19T21:27:13.865 INFO:teuthology.orchestra.console:Power off smithi154
2022-12-19T21:27:13.906 INFO:teuthology.orchestra.console:Power off smithi099
2022-12-19T21:27:13.919 INFO:teuthology.orchestra.console:Power off smithi168
2022-12-19T21:27:13.995 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2022-12-19T21:27:14.013 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2022-12-19T21:27:14.027 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2022-12-19T21:27:14.047 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-12-19T21:27:14.096 INFO:teuthology.orchestra.console:Power on smithi005
2022-12-19T21:27:14.114 INFO:teuthology.orchestra.console:Power on smithi106
2022-12-19T21:27:14.129 INFO:teuthology.orchestra.console:Power on smithi154
2022-12-19T21:27:14.155 INFO:teuthology.orchestra.console:Power on smithi099
2022-12-19T21:27:22.481 INFO:teuthology.orchestra.console:Power on for smithi106 completed
2022-12-19T21:27:22.488 INFO:teuthology.orchestra.console:Power on for smithi154 completed
2022-12-19T21:27:22.515 INFO:teuthology.orchestra.console:Power on for smithi099 completed
2022-12-19T21:27:22.537 INFO:teuthology.orchestra.console:Power on for smithi005 completed
2022-12-19T21:27:22.582 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish
2022-12-19T21:27:22.589 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2022-12-19T21:27:22.616 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2022-12-19T21:27:22.638 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish
2022-12-19T21:29:26.755 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (15) after waiting for 60.0 seconds
2022-12-19T21:29:26.756 ERROR:teuthology.orchestra.console:Failed to power off smithi168
2022-12-19T21:29:26.756 INFO:teuthology.orchestra.console:Power on smithi168
2022-12-19T21:31:39.576 WARNING:teuthology.contextutil:'wait for power on' reached maximum tries (15) after waiting for 60.0 seconds
2022-12-19T21:31:39.638 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/dispatcher/supervisor.py", line 209, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/console.py", line 243, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi168
2022-12-19T21:31:39.725 INFO:teuthology.nuke:Checking targets against current locks
2022-12-19T21:31:39.779 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-19T21:31:39.820 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-19T21:31:39.855 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-19T21:31:39.870 INFO:teuthology.orchestra.console:Power off smithi005
2022-12-19T21:31:39.891 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-19T21:31:39.928 INFO:teuthology.orchestra.console:Power off smithi099
2022-12-19T21:31:39.976 INFO:teuthology.orchestra.console:Power off smithi106
2022-12-19T21:31:40.019 INFO:teuthology.orchestra.console:Power off smithi154
2022-12-19T21:31:41.042 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-12-19T21:31:41.121 INFO:teuthology.orchestra.console:Power off smithi168
2022-12-19T21:31:43.271 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:31:48.312 INFO:teuthology.orchestra.console:Power off for smithi099 completed
2022-12-19T21:31:48.350 INFO:teuthology.orchestra.console:Power off for smithi106 completed
2022-12-19T21:31:48.466 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2022-12-19T21:31:48.673 INFO:teuthology.lock.ops:unlocked: smithi106.front.sepia.ceph.com
2022-12-19T21:31:52.327 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:31:52.377 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2022-12-19T21:31:52.496 INFO:teuthology.orchestra.console:Power off for smithi154 completed
2022-12-19T21:31:52.523 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com
2022-12-19T21:31:53.636 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com
2022-12-19T21:31:58.599 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:01.383 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:32:07.655 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:10.439 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:32:16.711 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:19.495 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:32:25.767 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:28.551 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:32:34.823 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:37.607 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:32:43.879 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:46.663 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:32:52.935 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:32:55.719 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:01.991 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:04.775 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:11.051 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:13.835 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:20.135 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:22.919 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:29.191 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:31.979 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:38.247 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:41.033 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:47.303 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:50.092 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:33:53.944 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (15) after waiting for 60.0 seconds
2022-12-19T21:33:53.945 ERROR:teuthology.orchestra.console:Failed to power off smithi168
2022-12-19T21:33:53.997 INFO:teuthology.lock.ops:unlocked: smithi168.front.sepia.ceph.com
2022-12-19T21:33:56.359 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:33:59.143 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.154
2022-12-19T21:34:02.503 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.99
2022-12-19T21:34:04.212 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/dispatcher/__init__.py", line 63, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/dispatcher/supervisor.py", line 52, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/dispatcher/supervisor.py", line 209, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/lock/ops.py", line 324, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/provision/fog.py", line 85, in create
    self.remote.console.power_on()
  File "/home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/teuthology/orchestra/console.py", line 243, in power_on
    raise RuntimeError(err_msg)
RuntimeError: Failed to power on smithi168