2021-02-17T20:11:36.409 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-17T20:11:36.541 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi014.front.sepia.ceph.com' reimaging 2021-02-17T20:11:36.544 INFO:teuthology.lock.ops:Updating [ubuntu@smithi014.front.sepia.ceph.com]: reset os type and version on server 2021-02-17T20:11:36.544 INFO:teuthology.lock.ops:Updating smithi014.front.sepia.ceph.com on lock server 2021-02-17T20:11:36.568 INFO:teuthology.lock.ops:Node 'ubuntu@smithi014.front.sepia.ceph.com' reimaging is complete 2021-02-17T20:11:36.568 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging 2021-02-17T20:11:36.569 INFO:teuthology.lock.ops:Updating [ubuntu@smithi135.front.sepia.ceph.com]: reset os type and version on server 2021-02-17T20:11:36.569 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2021-02-17T20:11:36.597 INFO:teuthology.lock.ops:Node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging is complete 2021-02-17T20:11:36.800 INFO:teuthology.provision.fog.smithi014:Scheduling deploy of ubuntu 20.04 2021-02-17T20:11:36.824 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of ubuntu 20.04 2021-02-17T20:11:37.192 INFO:teuthology.orchestra.console:Power off smithi014 2021-02-17T20:11:37.244 INFO:teuthology.orchestra.console:Power off smithi135 2021-02-17T20:11:37.354 INFO:teuthology.orchestra.console:Power off for smithi014 completed 2021-02-17T20:11:37.385 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2021-02-17T20:11:37.455 INFO:teuthology.orchestra.console:Power on smithi014 2021-02-17T20:11:37.487 INFO:teuthology.orchestra.console:Power on smithi135 2021-02-17T20:11:45.825 INFO:teuthology.orchestra.console:Power on for smithi014 completed 2021-02-17T20:11:45.847 INFO:teuthology.orchestra.console:Power on for smithi135 completed 2021-02-17T20:11:45.927 INFO:teuthology.provision.fog.smithi014:Waiting for deploy to finish 2021-02-17T20:11:45.948 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2021-02-17T20:16:14.643 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-17T20:16:15.168 INFO:teuthology.provision.fog.smithi014:Node is ready 2021-02-17T20:16:15.283 INFO:teuthology.orchestra.run.smithi014.stdout:smithi014.front.sepia.ceph.com 2021-02-17T20:16:15.290 INFO:teuthology.orchestra.run.smithi014.stdout:172.21.15.14 smithi014.front.sepia.ceph.com smithi014 2021-02-17T20:16:15.511 INFO:teuthology.provision.fog.smithi014:Deploy complete! 2021-02-17T20:16:48.336 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-17T20:16:49.174 INFO:teuthology.provision.fog.smithi135:Node is ready 2021-02-17T20:16:49.181 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135 2021-02-17T20:16:49.189 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2021-02-17T20:16:49.628 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2021-02-17T20:16:49.810 INFO:teuthology.lock.ops:Checking smithi014.front.sepia.ceph.com 2021-02-17T20:16:49.814 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-17T20:16:49.831 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2021-02-17T20:16:49.831 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-17T20:16:49.851 INFO:teuthology.lock.ops:Updating [smithi014.front.sepia.ceph.com]: set os type and version on server 2021-02-17T20:16:49.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-17T20:16:50.173 INFO:teuthology.orchestra.run.smithi014.stdout:x86_64 2021-02-17T20:16:50.178 INFO:teuthology.orchestra.run.smithi014.stdout:NAME="Ubuntu" 2021-02-17T20:16:50.179 INFO:teuthology.orchestra.run.smithi014.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-02-17T20:16:50.179 INFO:teuthology.orchestra.run.smithi014.stdout:ID=ubuntu 2021-02-17T20:16:50.179 INFO:teuthology.orchestra.run.smithi014.stdout:ID_LIKE=debian 2021-02-17T20:16:50.179 INFO:teuthology.orchestra.run.smithi014.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-02-17T20:16:50.180 INFO:teuthology.orchestra.run.smithi014.stdout:VERSION_ID="20.04" 2021-02-17T20:16:50.180 INFO:teuthology.orchestra.run.smithi014.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-17T20:16:50.180 INFO:teuthology.orchestra.run.smithi014.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-17T20:16:50.180 INFO:teuthology.orchestra.run.smithi014.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-17T20:16:50.181 INFO:teuthology.orchestra.run.smithi014.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-17T20:16:50.181 INFO:teuthology.orchestra.run.smithi014.stdout:VERSION_CODENAME=focal 2021-02-17T20:16:50.181 INFO:teuthology.orchestra.run.smithi014.stdout:UBUNTU_CODENAME=focal 2021-02-17T20:16:50.182 INFO:teuthology.lock.ops:Updating smithi014.front.sepia.ceph.com on lock server 2021-02-17T20:16:50.226 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2021-02-17T20:16:50.227 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-17T20:16:50.389 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2021-02-17T20:16:50.440 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="Ubuntu" 2021-02-17T20:16:50.441 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-02-17T20:16:50.441 INFO:teuthology.orchestra.run.smithi135.stdout:ID=ubuntu 2021-02-17T20:16:50.441 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE=debian 2021-02-17T20:16:50.442 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-02-17T20:16:50.442 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="20.04" 2021-02-17T20:16:50.442 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-17T20:16:50.443 INFO:teuthology.orchestra.run.smithi135.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-17T20:16:50.443 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-17T20:16:50.443 INFO:teuthology.orchestra.run.smithi135.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-17T20:16:50.443 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_CODENAME=focal 2021-02-17T20:16:50.444 INFO:teuthology.orchestra.run.smithi135.stdout:UBUNTU_CODENAME=focal 2021-02-17T20:16:50.444 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2021-02-17T20:16:50.511 INFO:teuthology.dispatcher.supervisor:Running job 5891023 2021-02-17T20:16:50.512 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2021-02-17_14:10:42-rados:cephadm-wip-swagner4-testing-2021-02-16-1548-distro-basic-smithi/5891023 --name swagner-2021-02-17_14:10:42-rados:cephadm-wip-swagner4-testing-2021-02-16-1548-distro-basic-smithi --description rados:cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_20.04_podman_testing} fixed-2 mon_election/connectivity} -- /home/teuthworker/archive/swagner-2021-02-17_14:10:42-rados:cephadm-wip-swagner4-testing-2021-02-16-1548-distro-basic-smithi/5891023/orig.config.yaml 2021-02-17T20:16:50.516 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2021-02-17_14:10:42-rados:cephadm-wip-swagner4-testing-2021-02-16-1548-distro-basic-smithi/5891023 2021-02-17T20:16:50.517 INFO:teuthology.dispatcher.supervisor:Job PID: 21615 2021-02-17T20:16:50.517 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-18T08:17:06.517 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-18T08:17:10.704 INFO:teuthology.kill:Killing Pids: {21615} 2021-02-18T08:17:12.365 INFO:teuthology.kill:Nuking machines: ['smithi014', 'smithi135'] 2021-02-18T08:17:13.144 INFO:teuthology.kill:2021-02-18 08:17:13,143.143 INFO:teuthology.nuke:targets: 2021-02-18T08:17:13.145 INFO:teuthology.kill: smithi014.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr+eivtDXE5JGJVZhaTCf2FMU/7d62nvNn/tQ1JZ2qTqkdx9qlU5t5jmJfvAV+IW5qwMzM/AnDRjJX4KBVkOHyINPNdyvjXnU88SCOWTtYbxzOOzWqmCLvDzSAPCAqyPhlvFTSoR//DAqC2Zu3WNe7J790QUKk+DmIiVYSiQLMxMo6/4Osh9HjvuxMeK2Dy2jVStFo6Lmhy/GWLUbfXPkixKY+nLYtHVytQjDFfsId+hAkxVMFzazaUYh38UOv0QnA45CVhCY9vZthE8tFzIEEfzouKwlek4ApNM7CRDzM0azq28U1kP8JwBjvYyYU8er5VqiS0822g+7upo3xSf1aLsEK5+u4tp+J26nPNA2KZmBYnET872ThpGNda5uBj2dVNvYXXlI/gp7AHM73RaQvcEqfujqztwi31pcSalsc4+EFMVooDdcn8WEAeaHpt8BsyRhtStRBOLMjuBRRW40yKNvvobrwg5xdETGTYmFcVGDy2uQ/GvgvrxEHODrVY/0= 2021-02-18T08:17:13.145 INFO:teuthology.kill: smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM5JPTi8qy4/fOS/7utsvWlBA+DqeuDabHsqBNEOhRC+M6KcCO1ZRPYBBukCyYeOR2ZEmp5kjWy3laceVZpkJ2k+pAGKi9aM+2gH8QHiOj9HoGV4syRCX3MWDNwDCG5sV+VIJn+SGG4xivZmgE+ucIWdes6MbbUIXannDhL73BJCqVOjMwxOo4BabffAcWHI22qRO69XJteK1/SIEqjvSpisuulNrlDfuhxPi1E/nlb1s4ZS+u9qCCNsPxzz5ANQmTYt9ga4ayt0Z05tUScI4ZkvBJ1TJ4cS7JECTkVbxYl3VVEF2bs35gbcba1jxNbnkF02n/NetQ/domplfq8zToJ58YUQSl1DDQyCFZT6ICOc+9cPjyuXQK6K4Ggqpp+GevGA9XiMDaRELLami0BGprJ/BPL1gVy2ESrMvmQ/GWKLHbpeLw24RRJNh8cOAHg9az2/sntkVjzGsTa4RdX01w2LOOv0XAQNCjrX5CU2RHbBCwkhB8TnA9y46eOHC0GT8= 2021-02-18T08:17:13.145 INFO:teuthology.kill:2021-02-18 08:17:13,144.144 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-18T08:17:13.150 INFO:teuthology.kill:2021-02-18 08:17:13,150.150 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-18T08:17:13.208 INFO:teuthology.kill:2021-02-18 08:17:13,207.207 INFO:teuthology.orchestra.console:Power off smithi135 2021-02-18T08:17:13.220 INFO:teuthology.kill:2021-02-18 08:17:13,220.220 INFO:teuthology.orchestra.console:Power off smithi014 2021-02-18T08:17:21.568 INFO:teuthology.kill:2021-02-18 08:17:21,567.567 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2021-02-18T08:17:25.692 INFO:teuthology.kill:2021-02-18 08:17:25,691.691 INFO:teuthology.orchestra.console:Power off for smithi014 completed 2021-02-18T08:17:25.898 INFO:teuthology.task.internal:roles: ubuntu@smithi014.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-02-18T08:17:25.899 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-02-18T08:17:25.899 INFO:teuthology.misc:Compressing logs... 2021-02-18T08:17:25.900 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-18T08:17:44.390 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/misc.py", line 1372, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-02-18T08:17:44.440 INFO:teuthology.kill:No teuthology processes running 2021-02-18T08:17:45.347 INFO:teuthology.kill:Nuking machines: ['smithi014', 'smithi135'] 2021-02-18T08:17:46.126 INFO:teuthology.kill:2021-02-18 08:17:46,126.126 INFO:teuthology.nuke:targets: 2021-02-18T08:17:46.127 INFO:teuthology.kill: smithi014.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCr+eivtDXE5JGJVZhaTCf2FMU/7d62nvNn/tQ1JZ2qTqkdx9qlU5t5jmJfvAV+IW5qwMzM/AnDRjJX4KBVkOHyINPNdyvjXnU88SCOWTtYbxzOOzWqmCLvDzSAPCAqyPhlvFTSoR//DAqC2Zu3WNe7J790QUKk+DmIiVYSiQLMxMo6/4Osh9HjvuxMeK2Dy2jVStFo6Lmhy/GWLUbfXPkixKY+nLYtHVytQjDFfsId+hAkxVMFzazaUYh38UOv0QnA45CVhCY9vZthE8tFzIEEfzouKwlek4ApNM7CRDzM0azq28U1kP8JwBjvYyYU8er5VqiS0822g+7upo3xSf1aLsEK5+u4tp+J26nPNA2KZmBYnET872ThpGNda5uBj2dVNvYXXlI/gp7AHM73RaQvcEqfujqztwi31pcSalsc4+EFMVooDdcn8WEAeaHpt8BsyRhtStRBOLMjuBRRW40yKNvvobrwg5xdETGTYmFcVGDy2uQ/GvgvrxEHODrVY/0= 2021-02-18T08:17:46.127 INFO:teuthology.kill: smithi135.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM5JPTi8qy4/fOS/7utsvWlBA+DqeuDabHsqBNEOhRC+M6KcCO1ZRPYBBukCyYeOR2ZEmp5kjWy3laceVZpkJ2k+pAGKi9aM+2gH8QHiOj9HoGV4syRCX3MWDNwDCG5sV+VIJn+SGG4xivZmgE+ucIWdes6MbbUIXannDhL73BJCqVOjMwxOo4BabffAcWHI22qRO69XJteK1/SIEqjvSpisuulNrlDfuhxPi1E/nlb1s4ZS+u9qCCNsPxzz5ANQmTYt9ga4ayt0Z05tUScI4ZkvBJ1TJ4cS7JECTkVbxYl3VVEF2bs35gbcba1jxNbnkF02n/NetQ/domplfq8zToJ58YUQSl1DDQyCFZT6ICOc+9cPjyuXQK6K4Ggqpp+GevGA9XiMDaRELLami0BGprJ/BPL1gVy2ESrMvmQ/GWKLHbpeLw24RRJNh8cOAHg9az2/sntkVjzGsTa4RdX01w2LOOv0XAQNCjrX5CU2RHbBCwkhB8TnA9y46eOHC0GT8= 2021-02-18T08:17:46.149 INFO:teuthology.kill:2021-02-18 08:17:46,149.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-18T08:17:46.152 INFO:teuthology.kill:2021-02-18 08:17:46,151.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-18T08:17:46.209 INFO:teuthology.kill:2021-02-18 08:17:46,209.209 INFO:teuthology.orchestra.console:Power off smithi014 2021-02-18T08:17:46.222 INFO:teuthology.kill:2021-02-18 08:17:46,222.222 INFO:teuthology.orchestra.console:Power off smithi135 2021-02-18T08:17:46.354 INFO:teuthology.kill:2021-02-18 08:17:46,354.354 INFO:teuthology.orchestra.console:Power off for smithi014 completed 2021-02-18T08:17:46.365 INFO:teuthology.kill:2021-02-18 08:17:46,365.365 INFO:teuthology.orchestra.console:Power off for smithi135 completed 2021-02-18T08:17:46.498 INFO:teuthology.kill:2021-02-18 08:17:46,497.497 INFO:teuthology.lock.ops:unlocked smithi014.front.sepia.ceph.com 2021-02-18T08:17:46.504 INFO:teuthology.kill:2021-02-18 08:17:46,503.503 INFO:teuthology.lock.ops:unlocked smithi135.front.sepia.ceph.com 2021-02-18T08:19:46.692 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-18T08:19:46.768 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-18T08:19:46.769 INFO:teuthology.nuke:Checking targets against current locks 2021-02-18T08:19:46.841 INFO:teuthology.nuke:Not nuking smithi135.front.sepia.ceph.com because description doesn't match 2021-02-18T08:19:46.842 INFO:teuthology.nuke:Not nuking smithi014.front.sepia.ceph.com because description doesn't match