2021-03-24T11:48:37.196 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-24T11:48:37.303 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging
2021-03-24T11:48:37.304 INFO:teuthology.lock.ops:Updating [ubuntu@smithi043.front.sepia.ceph.com]: reset os type and version on server
2021-03-24T11:48:37.304 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2021-03-24T11:48:37.319 INFO:teuthology.lock.ops:Node 'ubuntu@smithi043.front.sepia.ceph.com' reimaging is complete
2021-03-24T11:48:37.320 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi161.front.sepia.ceph.com' reimaging
2021-03-24T11:48:37.320 INFO:teuthology.lock.ops:Updating [ubuntu@smithi161.front.sepia.ceph.com]: reset os type and version on server
2021-03-24T11:48:37.320 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2021-03-24T11:48:37.336 INFO:teuthology.lock.ops:Node 'ubuntu@smithi161.front.sepia.ceph.com' reimaging is complete
2021-03-24T11:48:37.519 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of ubuntu 18.04
2021-03-24T11:48:37.540 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of ubuntu 18.04
2021-03-24T11:48:37.930 INFO:teuthology.orchestra.console:Power off smithi161
2021-03-24T11:48:37.984 INFO:teuthology.orchestra.console:Power off smithi043
2021-03-24T11:48:46.350 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-03-24T11:48:46.452 INFO:teuthology.orchestra.console:Power on smithi043
2021-03-24T11:48:50.433 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2021-03-24T11:48:50.536 INFO:teuthology.orchestra.console:Power on smithi161
2021-03-24T11:48:54.791 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2021-03-24T11:48:54.813 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2021-03-24T11:48:54.893 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2021-03-24T11:48:54.914 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2021-03-24T11:52:58.571 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-24T11:53:10.636 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-24T11:53:19.692 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-24T11:53:25.787 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-24T11:53:26.144 INFO:teuthology.provision.fog.smithi043:Node is ready
2021-03-24T11:53:26.190 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2021-03-24T11:53:26.239 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2021-03-24T11:53:26.553 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2021-03-24T11:54:21.542 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-24T11:54:21.895 INFO:teuthology.provision.fog.smithi161:Node is ready
2021-03-24T11:54:21.942 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2021-03-24T11:54:21.991 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2021-03-24T11:54:22.310 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2021-03-24T11:54:22.478 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2021-03-24T11:54:22.479 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-24T11:54:22.496 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2021-03-24T11:54:22.497 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-24T11:54:22.512 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2021-03-24T11:54:22.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-24T11:54:22.824 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2021-03-24T11:54:22.874 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="Ubuntu"
2021-03-24T11:54:22.874 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-24T11:54:22.874 INFO:teuthology.orchestra.run.smithi043.stdout:ID=ubuntu
2021-03-24T11:54:22.875 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE=debian
2021-03-24T11:54:22.875 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-24T11:54:22.875 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="18.04"
2021-03-24T11:54:22.875 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-24T11:54:22.875 INFO:teuthology.orchestra.run.smithi043.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-24T11:54:22.876 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-24T11:54:22.876 INFO:teuthology.orchestra.run.smithi043.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-24T11:54:22.876 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_CODENAME=bionic
2021-03-24T11:54:22.876 INFO:teuthology.orchestra.run.smithi043.stdout:UBUNTU_CODENAME=bionic
2021-03-24T11:54:22.878 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2021-03-24T11:54:22.893 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2021-03-24T11:54:22.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-24T11:54:23.215 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2021-03-24T11:54:23.263 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu"
2021-03-24T11:54:23.263 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-24T11:54:23.263 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu
2021-03-24T11:54:23.264 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian
2021-03-24T11:54:23.264 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-24T11:54:23.264 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="18.04"
2021-03-24T11:54:23.264 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-24T11:54:23.265 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-24T11:54:23.265 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-24T11:54:23.265 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-24T11:54:23.265 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=bionic
2021-03-24T11:54:23.265 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=bionic
2021-03-24T11:54:23.266 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2021-03-24T11:54:23.337 INFO:teuthology.dispatcher.supervisor:Running job 5993444
2021-03-24T11:54:23.337 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444 --name sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} -- /home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444/orig.config.yaml
2021-03-24T11:54:23.341 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-03-24_06:13:24-upgrade:octopus-x-wip-sage-testing-2021-03-23-2309-distro-basic-smithi/5993444
2021-03-24T11:54:23.342 INFO:teuthology.dispatcher.supervisor:Job PID: 19351
2021-03-24T11:54:23.342 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-24T23:55:13.517 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-24T23:55:13.775 INFO:teuthology.kill:Killing Pids: {19351}
2021-03-24T23:55:14.891 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi161']
2021-03-24T23:55:15.815 INFO:teuthology.kill:2021-03-24 23:55:15,815.815 INFO:teuthology.nuke:targets:
2021-03-24T23:55:15.816 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPhwa3ibD1YBedhMFWy21AHn5O5CkJVIxaAk1movRw/4oSozYwafJi7eXneOBVXVbNhh7vzPlBz0MOSGeHrnB2EJ8Kcr4pX1eow9pYcfIHANjeNCsu691x5o/cFPiU082fvdvUeW3RMzsynsWATcTDPbjTFmx00+67Hl/pdH7QIsdv+SYbYDehzSu/5911Cb7GkyXrXbiVgnch/5puAGqbBWuOHxMctOA90xWHYr7JcVIJuzaD6pbCoBbVCCdVablXMXZQZc9/KUz+ztnh8r8Q9ATlTN97FyxFVI/zRKxHtNECfXooY+wLX7bo9I13pT2PFd4tyfkd63qdwXL+IgPL
2021-03-24T23:55:15.816 INFO:teuthology.kill:  smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaY1KZyL/Eub6ciQOfZ957YbBBCLIP6mYl/DzoNr02jwI6CUBSQdhU639DAVa0JXfjU4NmIQ53icIphzcgIZWp8HkCHbcGAeQpwsKjxSFWU2U3KkrVKypBqJxyF68bdH8Ul6PE6x91xOInzrdV6N3VYfrXLvox4njkEGgNhqGd/oPCtSJJqBc2NWqKolUTcVB/ltzFQPVB0jrjJhVzMMl34PuOPBwCw4pfs0+7Pf4K7Jq+uoZ1RM4rDYojkKB6q50EleDFOA+RZDSHComHd3t/ReRikRCZnb9TXfz4QFLb9q/HqahJcVVdEbH7Dvtq6m1LlC1ZqzFfrtl2ho+yvTbz
2021-03-24T23:55:15.816 INFO:teuthology.kill:2021-03-24 23:55:15,815.815 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T23:55:15.818 INFO:teuthology.kill:2021-03-24 23:55:15,817.817 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T23:55:15.880 INFO:teuthology.kill:2021-03-24 23:55:15,880.880 INFO:teuthology.orchestra.console:Power off smithi043
2021-03-24T23:55:15.896 INFO:teuthology.kill:2021-03-24 23:55:15,896.896 INFO:teuthology.orchestra.console:Power off smithi161
2021-03-24T23:55:24.259 INFO:teuthology.kill:2021-03-24 23:55:24,258.258 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2021-03-24T23:55:28.363 INFO:teuthology.kill:2021-03-24 23:55:28,363.363 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-03-24T23:55:28.618 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0']
2021-03-24T23:55:28.700 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2021-03-24T23:55:28.701 INFO:teuthology.misc:Compressing logs...
2021-03-24T23:55:28.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-24T23:56:03.399 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-24T23:56:03.450 INFO:teuthology.kill:No teuthology processes running
2021-03-24T23:56:04.509 INFO:teuthology.kill:Nuking machines: ['smithi043', 'smithi161']
2021-03-24T23:56:05.433 INFO:teuthology.kill:2021-03-24 23:56:05,432.432 INFO:teuthology.nuke:targets:
2021-03-24T23:56:05.434 INFO:teuthology.kill:  smithi043.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPhwa3ibD1YBedhMFWy21AHn5O5CkJVIxaAk1movRw/4oSozYwafJi7eXneOBVXVbNhh7vzPlBz0MOSGeHrnB2EJ8Kcr4pX1eow9pYcfIHANjeNCsu691x5o/cFPiU082fvdvUeW3RMzsynsWATcTDPbjTFmx00+67Hl/pdH7QIsdv+SYbYDehzSu/5911Cb7GkyXrXbiVgnch/5puAGqbBWuOHxMctOA90xWHYr7JcVIJuzaD6pbCoBbVCCdVablXMXZQZc9/KUz+ztnh8r8Q9ATlTN97FyxFVI/zRKxHtNECfXooY+wLX7bo9I13pT2PFd4tyfkd63qdwXL+IgPL
2021-03-24T23:56:05.434 INFO:teuthology.kill:  smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCaY1KZyL/Eub6ciQOfZ957YbBBCLIP6mYl/DzoNr02jwI6CUBSQdhU639DAVa0JXfjU4NmIQ53icIphzcgIZWp8HkCHbcGAeQpwsKjxSFWU2U3KkrVKypBqJxyF68bdH8Ul6PE6x91xOInzrdV6N3VYfrXLvox4njkEGgNhqGd/oPCtSJJqBc2NWqKolUTcVB/ltzFQPVB0jrjJhVzMMl34PuOPBwCw4pfs0+7Pf4K7Jq+uoZ1RM4rDYojkKB6q50EleDFOA+RZDSHComHd3t/ReRikRCZnb9TXfz4QFLb9q/HqahJcVVdEbH7Dvtq6m1LlC1ZqzFfrtl2ho+yvTbz
2021-03-24T23:56:05.454 INFO:teuthology.kill:2021-03-24 23:56:05,454.454 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T23:56:05.457 INFO:teuthology.kill:2021-03-24 23:56:05,456.456 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T23:56:05.515 INFO:teuthology.kill:2021-03-24 23:56:05,515.515 INFO:teuthology.orchestra.console:Power off smithi161
2021-03-24T23:56:05.530 INFO:teuthology.kill:2021-03-24 23:56:05,529.529 INFO:teuthology.orchestra.console:Power off smithi043
2021-03-24T23:56:05.662 INFO:teuthology.kill:2021-03-24 23:56:05,662.662 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2021-03-24T23:56:05.674 INFO:teuthology.kill:2021-03-24 23:56:05,674.674 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2021-03-24T23:56:05.807 INFO:teuthology.kill:2021-03-24 23:56:05,806.806 INFO:teuthology.lock.ops:unlocked smithi161.front.sepia.ceph.com
2021-03-24T23:56:05.811 INFO:teuthology.kill:2021-03-24 23:56:05,811.811 INFO:teuthology.lock.ops:unlocked smithi043.front.sepia.ceph.com
2021-03-24T23:58:06.081 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-24T23:58:06.162 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-24T23:58:06.163 INFO:teuthology.nuke:Checking targets against current locks
2021-03-24T23:58:06.239 INFO:teuthology.nuke:Not nuking smithi043.front.sepia.ceph.com because description doesn't match
2021-03-24T23:58:06.239 INFO:teuthology.nuke:Not nuking smithi161.front.sepia.ceph.com because description doesn't match