2021-02-19T17:02:51.103 INFO:root:teuthology version: 1.1.0-9a6b849c 2021-02-19T17:02:51.235 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging 2021-02-19T17:02:51.237 INFO:teuthology.lock.ops:Updating [ubuntu@smithi042.front.sepia.ceph.com]: reset os type and version on server 2021-02-19T17:02:51.238 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2021-02-19T17:02:51.264 INFO:teuthology.lock.ops:Node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging is complete 2021-02-19T17:02:51.265 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging 2021-02-19T17:02:51.266 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server 2021-02-19T17:02:51.266 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2021-02-19T17:02:51.283 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete 2021-02-19T17:02:51.470 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of ubuntu 18.04 2021-02-19T17:02:51.516 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 18.04 2021-02-19T17:02:51.846 INFO:teuthology.orchestra.console:Power off smithi042 2021-02-19T17:02:51.892 INFO:teuthology.orchestra.console:Power off smithi107 2021-02-19T17:02:52.035 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2021-02-19T17:02:52.136 INFO:teuthology.orchestra.console:Power on smithi107 2021-02-19T17:02:56.393 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2021-02-19T17:02:56.495 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2021-02-19T17:03:00.228 INFO:teuthology.orchestra.console:Power off for smithi042 completed 2021-02-19T17:03:00.329 INFO:teuthology.orchestra.console:Power on smithi042 2021-02-19T17:03:04.588 INFO:teuthology.orchestra.console:Power on for smithi042 completed 2021-02-19T17:03:04.689 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2021-02-19T17:07:13.859 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-19T17:07:19.898 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-19T17:07:25.917 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-19T17:07:31.931 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-02-19T17:07:38.034 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-19T17:07:38.543 INFO:teuthology.provision.fog.smithi042:Node is ready 2021-02-19T17:07:38.549 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2021-02-19T17:07:38.600 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2021-02-19T17:07:38.882 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2021-02-19T17:08:07.781 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-19T17:08:08.248 INFO:teuthology.provision.fog.smithi107:Node is ready 2021-02-19T17:08:08.297 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2021-02-19T17:08:08.349 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2021-02-19T17:08:08.682 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2021-02-19T17:08:08.815 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2021-02-19T17:08:08.816 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-19T17:08:08.832 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2021-02-19T17:08:08.832 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-19T17:08:08.847 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2021-02-19T17:08:08.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-19T17:08:09.179 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2021-02-19T17:08:09.227 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2021-02-19T17:08:09.227 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-19T17:08:09.228 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2021-02-19T17:08:09.228 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2021-02-19T17:08:09.228 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-19T17:08:09.229 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="18.04" 2021-02-19T17:08:09.229 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-19T17:08:09.230 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-19T17:08:09.230 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-19T17:08:09.230 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-19T17:08:09.231 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=bionic 2021-02-19T17:08:09.231 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=bionic 2021-02-19T17:08:09.232 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2021-02-19T17:08:09.249 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2021-02-19T17:08:09.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-19T17:08:09.617 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2021-02-19T17:08:09.664 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2021-02-19T17:08:09.665 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-19T17:08:09.665 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2021-02-19T17:08:09.665 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2021-02-19T17:08:09.665 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-19T17:08:09.666 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="18.04" 2021-02-19T17:08:09.666 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-19T17:08:09.666 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-19T17:08:09.666 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-19T17:08:09.667 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-19T17:08:09.667 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=bionic 2021-02-19T17:08:09.667 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=bionic 2021-02-19T17:08:09.667 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2021-02-19T17:08:09.738 INFO:teuthology.dispatcher.supervisor:Running job 5894503 2021-02-19T17:08:09.738 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-02-19_15:05:48-upgrade-wip-sage2-testing-2021-02-19-0836-distro-basic-smithi/5894503 --name sage-2021-02-19_15:05:48-upgrade-wip-sage2-testing-2021-02-19-0836-distro-basic-smithi --description upgrade/pacific-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} -- /home/teuthworker/archive/sage-2021-02-19_15:05:48-upgrade-wip-sage2-testing-2021-02-19-0836-distro-basic-smithi/5894503/orig.config.yaml 2021-02-19T17:08:09.741 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-02-19_15:05:48-upgrade-wip-sage2-testing-2021-02-19-0836-distro-basic-smithi/5894503 2021-02-19T17:08:09.742 INFO:teuthology.dispatcher.supervisor:Job PID: 644 2021-02-19T17:08:09.742 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-19T17:30:10.218 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-19T17:30:10.376 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-19T17:30:10.376 INFO:teuthology.nuke:Checking targets against current locks 2021-02-19T17:30:10.448 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 59, in main verbose File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 152, in run_job unlock_targets(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/dispatcher/supervisor.py", line 196, in unlock_targets nuke(fake_ctx, True) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/nuke/__init__.py", line 250, in nuke if ctx.name not in lock['description']: TypeError: argument of type 'NoneType' is not iterable