2021-02-15T09:58:22.140 INFO:root:teuthology version: 1.1.0-64d5f180
2021-02-15T09:58:22.243 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba001.front.sepia.ceph.com' reimaging
2021-02-15T09:58:22.244 INFO:teuthology.lock.ops:Updating [ubuntu@gibba001.front.sepia.ceph.com]: reset os type and version on server
2021-02-15T09:58:22.244 INFO:teuthology.lock.ops:Updating gibba001.front.sepia.ceph.com on lock server
2021-02-15T09:58:22.260 INFO:teuthology.lock.ops:Node 'ubuntu@gibba001.front.sepia.ceph.com' reimaging is complete
2021-02-15T09:58:22.260 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba014.front.sepia.ceph.com' reimaging
2021-02-15T09:58:22.261 INFO:teuthology.lock.ops:Updating [ubuntu@gibba014.front.sepia.ceph.com]: reset os type and version on server
2021-02-15T09:58:22.261 INFO:teuthology.lock.ops:Updating gibba014.front.sepia.ceph.com on lock server
2021-02-15T09:58:22.275 INFO:teuthology.lock.ops:Node 'ubuntu@gibba014.front.sepia.ceph.com' reimaging is complete
2021-02-15T09:58:22.453 INFO:teuthology.provision.fog.gibba001:Scheduling deploy of ubuntu 18.04
2021-02-15T09:58:22.496 INFO:teuthology.provision.fog.gibba014:Scheduling deploy of ubuntu 18.04
2021-02-15T09:58:22.827 INFO:teuthology.orchestra.console:Power off gibba001
2021-02-15T09:58:22.865 INFO:teuthology.orchestra.console:Power off gibba014
2021-02-15T09:58:31.201 INFO:teuthology.orchestra.console:Power off for gibba001 completed
2021-02-15T09:58:31.240 INFO:teuthology.orchestra.console:Power off for gibba014 completed
2021-02-15T09:58:31.303 INFO:teuthology.orchestra.console:Power on gibba001
2021-02-15T09:58:31.341 INFO:teuthology.orchestra.console:Power on gibba014
2021-02-15T09:58:39.686 INFO:teuthology.orchestra.console:Power on for gibba001 completed
2021-02-15T09:58:39.713 INFO:teuthology.orchestra.console:Power on for gibba014 completed
2021-02-15T09:58:39.787 INFO:teuthology.provision.fog.gibba001:Waiting for deploy to finish
2021-02-15T09:58:39.813 INFO:teuthology.provision.fog.gibba014:Waiting for deploy to finish
2021-02-15T10:03:00.802 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-15T10:03:06.816 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-15T10:03:06.817 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-15T10:03:18.856 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-02-15T10:03:21.972 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-15T10:03:22.393 INFO:teuthology.provision.fog.gibba001:Node is ready
2021-02-15T10:03:22.439 INFO:teuthology.orchestra.run.gibba001.stdout:gibba001.front.sepia.ceph.com
2021-02-15T10:03:22.490 INFO:teuthology.orchestra.run.gibba001.stdout:172.21.2.101 gibba001.front.sepia.ceph.com gibba001
2021-02-15T10:03:22.760 INFO:teuthology.provision.fog.gibba001:Deploy complete!
2021-02-15T10:03:24.925 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-02-15T10:03:25.312 INFO:teuthology.provision.fog.gibba014:Node is ready
2021-02-15T10:03:25.358 INFO:teuthology.orchestra.run.gibba014.stdout:gibba014.front.sepia.ceph.com
2021-02-15T10:03:25.402 INFO:teuthology.orchestra.run.gibba014.stdout:172.21.2.114 gibba014.front.sepia.ceph.com gibba014
2021-02-15T10:03:25.682 INFO:teuthology.provision.fog.gibba014:Deploy complete!
2021-02-15T10:03:25.803 INFO:teuthology.lock.ops:Checking gibba001.front.sepia.ceph.com
2021-02-15T10:03:25.804 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-15T10:03:25.825 INFO:teuthology.lock.ops:Checking gibba014.front.sepia.ceph.com
2021-02-15T10:03:25.825 INFO:teuthology.lock.ops:New key found. Updating...
2021-02-15T10:03:25.845 INFO:teuthology.lock.ops:Updating [gibba001.front.sepia.ceph.com]: set os type and version on server
2021-02-15T10:03:25.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-15T10:03:26.114 INFO:teuthology.orchestra.run.gibba001.stdout:x86_64
2021-02-15T10:03:26.158 INFO:teuthology.orchestra.run.gibba001.stdout:NAME="Ubuntu"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:ID=ubuntu
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:ID_LIKE=debian
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION_ID="18.04"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:HOME_URL="https://www.ubuntu.com/"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-02-15T10:03:26.159 INFO:teuthology.orchestra.run.gibba001.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-02-15T10:03:26.160 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION_CODENAME=bionic
2021-02-15T10:03:26.160 INFO:teuthology.orchestra.run.gibba001.stdout:UBUNTU_CODENAME=bionic
2021-02-15T10:03:26.161 INFO:teuthology.lock.ops:Updating gibba001.front.sepia.ceph.com on lock server
2021-02-15T10:03:26.177 INFO:teuthology.lock.ops:Updating [gibba014.front.sepia.ceph.com]: set os type and version on server
2021-02-15T10:03:26.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-15T10:03:26.442 INFO:teuthology.orchestra.run.gibba014.stdout:x86_64
2021-02-15T10:03:26.486 INFO:teuthology.orchestra.run.gibba014.stdout:NAME="Ubuntu"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:ID=ubuntu
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:ID_LIKE=debian
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:VERSION_ID="18.04"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:HOME_URL="https://www.ubuntu.com/"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:VERSION_CODENAME=bionic
2021-02-15T10:03:26.487 INFO:teuthology.orchestra.run.gibba014.stdout:UBUNTU_CODENAME=bionic
2021-02-15T10:03:26.488 INFO:teuthology.lock.ops:Updating gibba014.front.sepia.ceph.com on lock server
2021-02-15T10:03:26.566 INFO:teuthology.dispatcher.supervisor:Running job 5880211
2021-02-15T10:03:26.567 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-02-14_07:01:02-rados-master-distro-basic-gibba/5880211 --name teuthology-2021-02-14_07:01:02-rados-master-distro-basic-gibba --description rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} -- /home/teuthworker/archive/teuthology-2021-02-14_07:01:02-rados-master-distro-basic-gibba/5880211/orig.config.yaml
2021-02-15T10:03:26.570 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-02-14_07:01:02-rados-master-distro-basic-gibba/5880211
2021-02-15T10:03:26.570 INFO:teuthology.dispatcher.supervisor:Job PID: 20772
2021-02-15T10:03:26.570 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-02-15T22:03:45.971 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-02-15T22:03:46.669 INFO:teuthology.kill:Killing Pids: {20772}
2021-02-15T22:03:48.556 INFO:teuthology.kill:Nuking machines: ['gibba001', 'gibba014']
2021-02-15T22:03:49.525 INFO:teuthology.kill:2021-02-15 22:03:49,524.524 INFO:teuthology.nuke:targets:
2021-02-15T22:03:49.526 INFO:teuthology.kill:  gibba001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtMvdjnlfsFh6AXLYyHhFb5P3z+Kbm2zA8JGwhJg6RKeStUN+KNkF1qyT8Xvtac+MTkB4oxt6v25MeysyDS0X6pqDceKFLIFG3e1AC3ljJfzKNoQ8c909oxzVxWutDvHLU6XEa1lQSdl1mMLZRxD4/9b72FWrcx2+kFPTKZaBz2jDe2qoCLua7PGpRdgrCPTf8uAkrJm0kk2dC38tTZt2p1m5pkx6g89m556PLqxTBR8mihyoOrd3XJBu+rjqE2q5e6CESicAUl8tsyWo0iWPnVSuOUIcdC4VJt90jA3nNt6bSOC2ru471KK4mJifWZSKHjxq/VjlG/L/Ays3qX7/B
2021-02-15T22:03:49.526 INFO:teuthology.kill:  gibba014.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8n/+rF+Kvw4jLrcLmtLsepsIs13U0Uc4g2p7NOv5N0VzV4gtkL3D3N/50AQ8rqHdrKOaqlaa6HLazWpNFm7grOEoT/q6nbtMP5c3wV+Nek1fw4qgO9dRgnwKm8kjo05YugZmQGvuLAFZRLrW3rWakflaLMnQaiQl/X3z5qF5rWRC1c+Umkmu76mSBlYzl0MiHSImyMGtSoFCXpQTg4m6c1f9mNEVrGvPudn/TeYkR18qbRCeaj0RRht/ACtc/Kn4ZH3C9CPTZjZ4MWnCx/h8V2Jwdi6w8WanK8zIKbP7vD36+Fvpph3Cn9BYZ3ip103cpcIYc9Bdkmg1Pr33EJ73J
2021-02-15T22:03:49.526 INFO:teuthology.kill:2021-02-15 22:03:49,525.525 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-15T22:03:49.533 INFO:teuthology.kill:2021-02-15 22:03:49,533.533 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-15T22:03:49.603 INFO:teuthology.kill:2021-02-15 22:03:49,602.602 INFO:teuthology.orchestra.console:Power off gibba001
2021-02-15T22:03:49.622 INFO:teuthology.kill:2021-02-15 22:03:49,622.622 INFO:teuthology.orchestra.console:Power off gibba014
2021-02-15T22:03:58.072 INFO:teuthology.kill:2021-02-15 22:03:58,072.072 INFO:teuthology.orchestra.console:Power off for gibba001 completed
2021-02-15T22:04:02.127 INFO:teuthology.kill:2021-02-15 22:04:02,127.127 INFO:teuthology.orchestra.console:Power off for gibba014 completed
2021-02-15T22:04:02.676 INFO:teuthology.task.internal:roles: ubuntu@gibba001.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-02-15T22:04:02.677 INFO:teuthology.task.internal:roles: ubuntu@gibba014.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-02-15T22:04:02.681 INFO:teuthology.misc:Compressing logs...
2021-02-15T22:04:02.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-02-15T22:04:21.326 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/misc.py", line 1372, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-02-15T22:04:21.431 INFO:teuthology.kill:No teuthology processes running
2021-02-15T22:04:23.070 INFO:teuthology.kill:Nuking machines: ['gibba001', 'gibba014']
2021-02-15T22:04:24.064 INFO:teuthology.kill:2021-02-15 22:04:24,063.063 INFO:teuthology.nuke:targets:
2021-02-15T22:04:24.064 INFO:teuthology.kill:  gibba001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtMvdjnlfsFh6AXLYyHhFb5P3z+Kbm2zA8JGwhJg6RKeStUN+KNkF1qyT8Xvtac+MTkB4oxt6v25MeysyDS0X6pqDceKFLIFG3e1AC3ljJfzKNoQ8c909oxzVxWutDvHLU6XEa1lQSdl1mMLZRxD4/9b72FWrcx2+kFPTKZaBz2jDe2qoCLua7PGpRdgrCPTf8uAkrJm0kk2dC38tTZt2p1m5pkx6g89m556PLqxTBR8mihyoOrd3XJBu+rjqE2q5e6CESicAUl8tsyWo0iWPnVSuOUIcdC4VJt90jA3nNt6bSOC2ru471KK4mJifWZSKHjxq/VjlG/L/Ays3qX7/B
2021-02-15T22:04:24.064 INFO:teuthology.kill:  gibba014.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8n/+rF+Kvw4jLrcLmtLsepsIs13U0Uc4g2p7NOv5N0VzV4gtkL3D3N/50AQ8rqHdrKOaqlaa6HLazWpNFm7grOEoT/q6nbtMP5c3wV+Nek1fw4qgO9dRgnwKm8kjo05YugZmQGvuLAFZRLrW3rWakflaLMnQaiQl/X3z5qF5rWRC1c+Umkmu76mSBlYzl0MiHSImyMGtSoFCXpQTg4m6c1f9mNEVrGvPudn/TeYkR18qbRCeaj0RRht/ACtc/Kn4ZH3C9CPTZjZ4MWnCx/h8V2Jwdi6w8WanK8zIKbP7vD36+Fvpph3Cn9BYZ3ip103cpcIYc9Bdkmg1Pr33EJ73J
2021-02-15T22:04:24.091 INFO:teuthology.kill:2021-02-15 22:04:24,091.091 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-15T22:04:24.094 INFO:teuthology.kill:2021-02-15 22:04:24,094.094 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-02-15T22:04:24.160 INFO:teuthology.kill:2021-02-15 22:04:24,160.160 INFO:teuthology.orchestra.console:Power off gibba001
2021-02-15T22:04:24.181 INFO:teuthology.kill:2021-02-15 22:04:24,180.180 INFO:teuthology.orchestra.console:Power off gibba014
2021-02-15T22:04:24.346 INFO:teuthology.kill:2021-02-15 22:04:24,346.346 INFO:teuthology.orchestra.console:Power off for gibba001 completed
2021-02-15T22:04:24.351 INFO:teuthology.kill:2021-02-15 22:04:24,351.351 INFO:teuthology.orchestra.console:Power off for gibba014 completed
2021-02-15T22:04:24.503 INFO:teuthology.kill:2021-02-15 22:04:24,502.502 INFO:teuthology.lock.ops:unlocked gibba001.front.sepia.ceph.com
2021-02-15T22:04:24.506 INFO:teuthology.kill:2021-02-15 22:04:24,506.506 INFO:teuthology.lock.ops:unlocked gibba014.front.sepia.ceph.com
2021-02-15T22:06:24.774 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-02-15T22:06:24.872 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-02-15T22:06:24.876 INFO:teuthology.nuke:Checking targets against current locks
2021-02-15T22:06:25.157 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_64d5f18051c2fa3ad001b1c48f945134f60a8f76/teuthology/nuke/__init__.py", line 250, in nuke
    if ctx.name not in lock['description']:
TypeError: argument of type 'NoneType' is not iterable