2021-03-13T09:48:15.044 INFO:root:teuthology version: 1.1.0-b9656917
2021-03-13T09:48:15.148 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging
2021-03-13T09:48:15.149 INFO:teuthology.lock.ops:Updating [ubuntu@smithi076.front.sepia.ceph.com]: reset os type and version on server
2021-03-13T09:48:15.149 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2021-03-13T09:48:15.167 INFO:teuthology.lock.ops:Node 'ubuntu@smithi076.front.sepia.ceph.com' reimaging is complete
2021-03-13T09:48:15.167 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging
2021-03-13T09:48:15.167 INFO:teuthology.lock.ops:Updating [ubuntu@smithi191.front.sepia.ceph.com]: reset os type and version on server
2021-03-13T09:48:15.168 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2021-03-13T09:48:15.186 INFO:teuthology.lock.ops:Node 'ubuntu@smithi191.front.sepia.ceph.com' reimaging is complete
2021-03-13T09:48:15.373 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of ubuntu 20.04
2021-03-13T09:48:15.384 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 20.04
2021-03-13T09:48:15.712 INFO:teuthology.orchestra.console:Power off smithi076
2021-03-13T09:48:15.732 INFO:teuthology.orchestra.console:Power off smithi191
2021-03-13T09:48:24.136 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-03-13T09:48:24.238 INFO:teuthology.orchestra.console:Power on smithi076
2021-03-13T09:48:28.237 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2021-03-13T09:48:28.339 INFO:teuthology.orchestra.console:Power on smithi191
2021-03-13T09:48:32.607 INFO:teuthology.orchestra.console:Power on for smithi076 completed
2021-03-13T09:48:32.708 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish
2021-03-13T09:48:36.712 INFO:teuthology.orchestra.console:Power on for smithi191 completed
2021-03-13T09:48:36.813 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2021-03-13T09:53:34.389 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-13T09:53:34.853 INFO:teuthology.provision.fog.smithi191:Node is ready
2021-03-13T09:53:34.867 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2021-03-13T09:53:34.879 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2021-03-13T09:53:35.165 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2021-03-13T09:53:55.089 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-13T09:53:55.615 INFO:teuthology.provision.fog.smithi076:Node is ready
2021-03-13T09:53:55.622 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com
2021-03-13T09:53:55.671 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076
2021-03-13T09:53:55.868 INFO:teuthology.provision.fog.smithi076:Deploy complete!
2021-03-13T09:53:56.077 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com
2021-03-13T09:53:56.081 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-13T09:53:56.098 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2021-03-13T09:53:56.098 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-13T09:53:56.112 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server
2021-03-13T09:53:56.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-13T09:53:56.292 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64
2021-03-13T09:53:56.342 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="Ubuntu"
2021-03-13T09:53:56.343 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-13T09:53:56.343 INFO:teuthology.orchestra.run.smithi076.stdout:ID=ubuntu
2021-03-13T09:53:56.343 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE=debian
2021-03-13T09:53:56.344 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-13T09:53:56.344 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="20.04"
2021-03-13T09:53:56.345 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-13T09:53:56.345 INFO:teuthology.orchestra.run.smithi076.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-13T09:53:56.345 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-13T09:53:56.346 INFO:teuthology.orchestra.run.smithi076.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-13T09:53:56.347 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_CODENAME=focal
2021-03-13T09:53:56.347 INFO:teuthology.orchestra.run.smithi076.stdout:UBUNTU_CODENAME=focal
2021-03-13T09:53:56.348 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server
2021-03-13T09:53:56.368 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2021-03-13T09:53:56.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-13T09:53:56.546 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2021-03-13T09:53:56.593 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu"
2021-03-13T09:53:56.594 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-13T09:53:56.594 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu
2021-03-13T09:53:56.594 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian
2021-03-13T09:53:56.595 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-13T09:53:56.595 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="20.04"
2021-03-13T09:53:56.595 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-13T09:53:56.595 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-13T09:53:56.595 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-13T09:53:56.596 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-13T09:53:56.596 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=focal
2021-03-13T09:53:56.596 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=focal
2021-03-13T09:53:56.597 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2021-03-13T09:53:56.682 INFO:teuthology.dispatcher.supervisor:Running job 5961075
2021-03-13T09:53:56.683 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi/5961075 --name kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} -- /home/teuthworker/archive/kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi/5961075/orig.config.yaml
2021-03-13T09:53:56.688 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-03-13_08:16:32-rados-wip-kefu-testing-2021-03-13-1449-distro-basic-smithi/5961075
2021-03-13T09:53:56.689 INFO:teuthology.dispatcher.supervisor:Job PID: 19693
2021-03-13T09:53:56.689 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-13T21:54:13.198 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-13T21:54:13.534 INFO:teuthology.kill:Killing Pids: {19693}
2021-03-13T21:54:16.269 INFO:teuthology.kill:Nuking machines: ['smithi076', 'smithi191']
2021-03-13T21:54:18.642 INFO:teuthology.kill:2021-03-13 21:54:18,642.642 INFO:teuthology.nuke:targets:
2021-03-13T21:54:18.644 INFO:teuthology.kill:  smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4BuFWh13SpFj9YLECj1OUrK9EtHXuxtxXnCJ3XRrMiIicJ9ouHRdd2FaMTEhPnJxakfae7/n9JaqVqEpc4qC7aCaarNElEm1/uQK78oard/OdNC+WGgAlgXpqV3CUKDkH13lvej18tM7Lc/+HyEOhNjJbC6j458I/8vIs6l8XlZ7t+XCKEWMPbDfDuzu1/uIcC1r7jEKNnoK20eX9TzjVLKTJx87myXJQBWJAQXlseMZp6O/rP3sE/EhOWQgoGe7Bvd7DRaKPsYgbRXv796KCjkxt0taVZd6Nx8DurrtwVxuiweul/r0gPoSqgyZAHZv6WfCUdQE7x0m9pSp9y0r45/p0UVI7XjhT8UnolEZ9MYnQp19BLF/vhn26KYToTKnB5L2XiVHB0BI13o22tc0InlF9QV2C3eyKUYduwTBMO/hZC3Pthm60Lt+B7u2dfiq1sesE9YUpgYN0Lrk8u1/dNzuC52R2HC+74oPG4IdcYHEs+G5UeAnojQvnolyfud0=
2021-03-13T21:54:18.644 INFO:teuthology.kill:  smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jMbHP/h9IAXF8WaS+tJiHteOz4Wk/VKR3Dux1VXmvK7JyJgfVG1CjM5Aespl7Tu6NEBQsrhCYIHZZcbqp56n5nwNjvv1B4Wrb6w4j+FVWuTAD1pYyIBjkiCoAEWVBjQFKrUpurSDuq173eG++4mhgZZ3wL28tGbJbnzJF9Ni+5HZaVsoLQdAn0lzLHW421rU2tWSejUGzXnPUiCc2o0IIMYMhew3SQm1xSQ+5XaR7TwLfcey+ktPpM0MUnYQMdZN0v9SLFYuZHQXXgb6e0LySNy/IE+WOoIQG0BYHSRxZOnWU3AicDc0jcR23unLtGsfAFjVPt7myJEW6RNHn3X+EDiQ/IT4F4k34zUvO3YlHlrhyDT1XSfc3w9+2fCscDgXtk4efnhDDZ7kNml/zbb8DS+7YQQtRzDws8FbZqT2J9SLGOG9C1t3rVYTa8Myeq0DHx8wOoPcrujR/pUlCObIMVbBopvANc+myj0bBnydLz+t2AdlazWKEk80IwxWVfM=
2021-03-13T21:54:18.644 INFO:teuthology.kill:2021-03-13 21:54:18,642.642 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-13T21:54:18.645 INFO:teuthology.kill:2021-03-13 21:54:18,645.645 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-13T21:54:18.769 INFO:teuthology.kill:2021-03-13 21:54:18,768.768 INFO:teuthology.orchestra.console:Power off smithi076
2021-03-13T21:54:18.839 INFO:teuthology.kill:2021-03-13 21:54:18,838.838 INFO:teuthology.orchestra.console:Power off smithi191
2021-03-13T21:54:27.369 INFO:teuthology.kill:2021-03-13 21:54:27,369.369 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-03-13T21:54:27.397 INFO:teuthology.kill:2021-03-13 21:54:27,397.397 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2021-03-13T21:54:27.843 INFO:teuthology.task.internal:roles: ubuntu@smithi076.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-03-13T21:54:27.857 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-03-13T21:54:27.857 INFO:teuthology.misc:Compressing logs...
2021-03-13T21:54:27.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-13T21:55:27.931 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-13T21:55:28.008 INFO:teuthology.kill:No teuthology processes running
2021-03-13T21:55:31.188 INFO:teuthology.kill:Nuking machines: ['smithi076', 'smithi191']
2021-03-13T21:55:33.648 INFO:teuthology.kill:2021-03-13 21:55:33,647.647 INFO:teuthology.nuke:targets:
2021-03-13T21:55:33.651 INFO:teuthology.kill:  smithi076.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4BuFWh13SpFj9YLECj1OUrK9EtHXuxtxXnCJ3XRrMiIicJ9ouHRdd2FaMTEhPnJxakfae7/n9JaqVqEpc4qC7aCaarNElEm1/uQK78oard/OdNC+WGgAlgXpqV3CUKDkH13lvej18tM7Lc/+HyEOhNjJbC6j458I/8vIs6l8XlZ7t+XCKEWMPbDfDuzu1/uIcC1r7jEKNnoK20eX9TzjVLKTJx87myXJQBWJAQXlseMZp6O/rP3sE/EhOWQgoGe7Bvd7DRaKPsYgbRXv796KCjkxt0taVZd6Nx8DurrtwVxuiweul/r0gPoSqgyZAHZv6WfCUdQE7x0m9pSp9y0r45/p0UVI7XjhT8UnolEZ9MYnQp19BLF/vhn26KYToTKnB5L2XiVHB0BI13o22tc0InlF9QV2C3eyKUYduwTBMO/hZC3Pthm60Lt+B7u2dfiq1sesE9YUpgYN0Lrk8u1/dNzuC52R2HC+74oPG4IdcYHEs+G5UeAnojQvnolyfud0=
2021-03-13T21:55:33.651 INFO:teuthology.kill:  smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3jMbHP/h9IAXF8WaS+tJiHteOz4Wk/VKR3Dux1VXmvK7JyJgfVG1CjM5Aespl7Tu6NEBQsrhCYIHZZcbqp56n5nwNjvv1B4Wrb6w4j+FVWuTAD1pYyIBjkiCoAEWVBjQFKrUpurSDuq173eG++4mhgZZ3wL28tGbJbnzJF9Ni+5HZaVsoLQdAn0lzLHW421rU2tWSejUGzXnPUiCc2o0IIMYMhew3SQm1xSQ+5XaR7TwLfcey+ktPpM0MUnYQMdZN0v9SLFYuZHQXXgb6e0LySNy/IE+WOoIQG0BYHSRxZOnWU3AicDc0jcR23unLtGsfAFjVPt7myJEW6RNHn3X+EDiQ/IT4F4k34zUvO3YlHlrhyDT1XSfc3w9+2fCscDgXtk4efnhDDZ7kNml/zbb8DS+7YQQtRzDws8FbZqT2J9SLGOG9C1t3rVYTa8Myeq0DHx8wOoPcrujR/pUlCObIMVbBopvANc+myj0bBnydLz+t2AdlazWKEk80IwxWVfM=
2021-03-13T21:55:33.677 INFO:teuthology.kill:2021-03-13 21:55:33,677.677 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-13T21:55:33.680 INFO:teuthology.kill:2021-03-13 21:55:33,680.680 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-13T21:55:33.784 INFO:teuthology.kill:2021-03-13 21:55:33,784.784 INFO:teuthology.orchestra.console:Power off smithi191
2021-03-13T21:55:33.860 INFO:teuthology.kill:2021-03-13 21:55:33,859.859 INFO:teuthology.orchestra.console:Power off smithi076
2021-03-13T21:55:34.050 INFO:teuthology.kill:2021-03-13 21:55:34,049.049 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2021-03-13T21:55:34.072 INFO:teuthology.kill:2021-03-13 21:55:34,071.071 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-03-13T21:55:34.190 INFO:teuthology.kill:2021-03-13 21:55:34,189.189 INFO:teuthology.lock.ops:unlocked smithi191.front.sepia.ceph.com
2021-03-13T21:55:34.213 INFO:teuthology.kill:2021-03-13 21:55:34,213.213 INFO:teuthology.lock.ops:unlocked smithi076.front.sepia.ceph.com
2021-03-13T21:57:34.534 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-13T21:57:34.678 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-13T21:57:34.678 INFO:teuthology.nuke:Checking targets against current locks
2021-03-13T21:57:34.786 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-13T21:57:34.796 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-13T21:57:34.900 INFO:teuthology.orchestra.console:Power off smithi076
2021-03-13T21:57:34.967 INFO:teuthology.orchestra.console:Power off smithi191
2021-03-13T21:57:47.564 INFO:teuthology.orchestra.console:Power off for smithi076 completed
2021-03-13T21:57:47.598 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2021-03-13T21:57:47.714 INFO:teuthology.lock.ops:unlocked smithi076.front.sepia.ceph.com
2021-03-13T21:57:47.737 INFO:teuthology.lock.ops:unlocked smithi191.front.sepia.ceph.com