2021-07-04T01:25:30.698 INFO:root:teuthology version: 1.1.0-26631ede
2021-07-04T01:25:30.819 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging
2021-07-04T01:25:30.821 INFO:teuthology.lock.ops:Updating [ubuntu@smithi078.front.sepia.ceph.com]: reset os type and version on server
2021-07-04T01:25:30.822 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2021-07-04T01:25:30.838 INFO:teuthology.lock.ops:Node 'ubuntu@smithi078.front.sepia.ceph.com' reimaging is complete
2021-07-04T01:25:30.839 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging
2021-07-04T01:25:30.839 INFO:teuthology.lock.ops:Updating [ubuntu@smithi111.front.sepia.ceph.com]: reset os type and version on server
2021-07-04T01:25:30.839 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2021-07-04T01:25:30.855 INFO:teuthology.lock.ops:Node 'ubuntu@smithi111.front.sepia.ceph.com' reimaging is complete
2021-07-04T01:25:30.855 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi199.front.sepia.ceph.com' reimaging
2021-07-04T01:25:30.856 INFO:teuthology.lock.ops:Updating [ubuntu@smithi199.front.sepia.ceph.com]: reset os type and version on server
2021-07-04T01:25:30.856 INFO:teuthology.lock.ops:Updating smithi199.front.sepia.ceph.com on lock server
2021-07-04T01:25:30.872 INFO:teuthology.lock.ops:Node 'ubuntu@smithi199.front.sepia.ceph.com' reimaging is complete
2021-07-04T01:25:31.072 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of ubuntu 20.04
2021-07-04T01:25:31.083 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 20.04
2021-07-04T01:25:31.094 INFO:teuthology.provision.fog.smithi199:Scheduling deploy of ubuntu 20.04
2021-07-04T01:25:31.453 INFO:teuthology.orchestra.console:Power off smithi078
2021-07-04T01:25:31.491 INFO:teuthology.orchestra.console:Power off smithi111
2021-07-04T01:25:31.503 INFO:teuthology.orchestra.console:Power off smithi199
2021-07-04T01:25:39.837 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-07-04T01:25:39.938 INFO:teuthology.orchestra.console:Power on smithi078
2021-07-04T01:25:43.972 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2021-07-04T01:25:43.976 INFO:teuthology.orchestra.console:Power off for smithi199 completed
2021-07-04T01:25:44.074 INFO:teuthology.orchestra.console:Power on smithi111
2021-07-04T01:25:44.081 INFO:teuthology.orchestra.console:Power on smithi199
2021-07-04T01:25:48.303 INFO:teuthology.orchestra.console:Power on for smithi078 completed
2021-07-04T01:25:48.328 INFO:teuthology.orchestra.console:Power on for smithi199 completed
2021-07-04T01:25:48.404 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish
2021-07-04T01:25:48.429 INFO:teuthology.provision.fog.smithi199:Waiting for deploy to finish
2021-07-04T01:25:52.431 INFO:teuthology.orchestra.console:Power on for smithi111 completed
2021-07-04T01:25:52.532 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2021-07-04T01:30:43.294 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-04T01:30:43.735 INFO:teuthology.provision.fog.smithi078:Node is ready
2021-07-04T01:30:43.742 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com
2021-07-04T01:30:43.791 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078
2021-07-04T01:30:43.981 INFO:teuthology.provision.fog.smithi078:Deploy complete!
2021-07-04T01:30:49.261 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-04T01:30:49.728 INFO:teuthology.provision.fog.smithi199:Node is ready
2021-07-04T01:30:49.777 INFO:teuthology.orchestra.run.smithi199.stdout:smithi199.front.sepia.ceph.com
2021-07-04T01:30:49.784 INFO:teuthology.orchestra.run.smithi199.stdout:172.21.15.199 smithi199.front.sepia.ceph.com smithi199
2021-07-04T01:30:49.973 INFO:teuthology.provision.fog.smithi199:Deploy complete!
2021-07-04T01:31:23.457 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-04T01:31:23.855 INFO:teuthology.provision.fog.smithi111:Node is ready
2021-07-04T01:31:23.862 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2021-07-04T01:31:23.916 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2021-07-04T01:31:24.142 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2021-07-04T01:31:24.343 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com
2021-07-04T01:31:24.344 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-04T01:31:24.364 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2021-07-04T01:31:24.365 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-04T01:31:24.379 INFO:teuthology.lock.ops:Checking smithi199.front.sepia.ceph.com
2021-07-04T01:31:24.379 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-04T01:31:24.396 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server
2021-07-04T01:31:24.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-04T01:31:24.655 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64
2021-07-04T01:31:24.662 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu"
2021-07-04T01:31:24.662 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-04T01:31:24.663 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu
2021-07-04T01:31:24.663 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian
2021-07-04T01:31:24.663 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-04T01:31:24.663 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="20.04"
2021-07-04T01:31:24.664 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-04T01:31:24.664 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-04T01:31:24.664 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-04T01:31:24.664 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-04T01:31:24.664 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=focal
2021-07-04T01:31:24.665 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=focal
2021-07-04T01:31:24.666 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server
2021-07-04T01:31:24.689 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2021-07-04T01:31:24.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-04T01:31:24.854 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2021-07-04T01:31:24.861 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu"
2021-07-04T01:31:24.861 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-07-04T01:31:24.861 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu
2021-07-04T01:31:24.862 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian
2021-07-04T01:31:24.862 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-07-04T01:31:24.862 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04"
2021-07-04T01:31:24.862 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/"
2021-07-04T01:31:24.863 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-07-04T01:31:24.863 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-07-04T01:31:24.863 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-07-04T01:31:24.863 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal
2021-07-04T01:31:24.864 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal
2021-07-04T01:31:24.864 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2021-07-04T01:31:24.882 INFO:teuthology.lock.ops:Updating [smithi199.front.sepia.ceph.com]: set os type and version on server
2021-07-04T01:31:24.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-04T02:32:25.235 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 163, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/lock/ops.py", line 319, in reimage_machines
    update_nodes(reimaged)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/lock/ops.py", line 38, in update_nodes
    inventory_info = remote.inventory_info
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 663, in inventory_info
    node['arch'] = self.arch
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 320, in arch
    self._arch = self.sh('uname -m').strip()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 96, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 100, in execute
    self.client.exec_command(self.command)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 508, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 879, in open_session
    timeout=timeout,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1010, in open_channel
    raise SSHException("Timeout opening channel.")
paramiko.ssh_exception.SSHException: Timeout opening channel.
2021-07-04T02:32:25.300 INFO:teuthology.nuke:Checking targets against current locks
2021-07-04T02:32:25.396 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-04T02:32:25.400 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-04T02:32:25.401 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-04T02:32:25.461 INFO:teuthology.orchestra.console:Power off smithi078
2021-07-04T02:32:25.477 INFO:teuthology.orchestra.console:Power off smithi199
2021-07-04T02:32:25.488 INFO:teuthology.orchestra.console:Power off smithi111
2021-07-04T02:32:33.849 INFO:teuthology.orchestra.console:Power off for smithi078 completed
2021-07-04T02:32:33.854 INFO:teuthology.orchestra.console:Power off for smithi199 completed
2021-07-04T02:32:33.861 INFO:teuthology.orchestra.console:Power off for smithi111 completed
2021-07-04T02:32:33.994 INFO:teuthology.lock.ops:unlocked smithi078.front.sepia.ceph.com
2021-07-04T02:32:33.998 INFO:teuthology.lock.ops:unlocked smithi199.front.sepia.ceph.com
2021-07-04T02:32:34.002 INFO:teuthology.lock.ops:unlocked smithi111.front.sepia.ceph.com
2021-07-04T02:32:34.002 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 50, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/dispatcher/supervisor.py", line 163, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/lock/ops.py", line 319, in reimage_machines
    update_nodes(reimaged)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/lock/ops.py", line 38, in update_nodes
    inventory_info = remote.inventory_info
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 663, in inventory_info
    node['arch'] = self.arch
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 320, in arch
    self._arch = self.sh('uname -m').strip()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 96, in sh
    proc = self.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/remote.py", line 509, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 100, in execute
    self.client.exec_command(self.command)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/client.py", line 508, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 879, in open_session
    timeout=timeout,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/lib/python3.6/site-packages/paramiko/transport.py", line 1010, in open_channel
    raise SSHException("Timeout opening channel.")
paramiko.ssh_exception.SSHException: Timeout opening channel.