2021-02-17T11:51:33.664 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-17T11:51:33.777 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging 2021-02-17T11:51:33.778 INFO:teuthology.lock.ops:Updating [ubuntu@smithi145.front.sepia.ceph.com]: reset os type and version on server 2021-02-17T11:51:33.779 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2021-02-17T11:51:33.802 INFO:teuthology.lock.ops:Node 'ubuntu@smithi145.front.sepia.ceph.com' reimaging is complete 2021-02-17T11:51:33.802 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging 2021-02-17T11:51:33.802 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server 2021-02-17T11:51:33.803 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-02-17T11:51:33.819 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete 2021-02-17T11:51:34.040 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of ubuntu 20.04 2021-02-17T11:51:34.097 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of ubuntu 20.04 2021-02-17T11:51:34.510 INFO:teuthology.orchestra.console:Power off smithi145 2021-02-17T11:51:34.546 INFO:teuthology.orchestra.console:Power off smithi155 2021-02-17T11:51:34.655 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2021-02-17T11:51:34.690 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-02-17T11:51:34.757 INFO:teuthology.orchestra.console:Power on smithi145 2021-02-17T11:51:34.792 INFO:teuthology.orchestra.console:Power on smithi155 2021-02-17T11:51:43.170 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2021-02-17T11:51:43.198 INFO:teuthology.orchestra.console:Power on for smithi145 completed 2021-02-17T11:51:43.271 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2021-02-17T11:51:43.300 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2021-02-17T11:56:45.325 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-17T11:56:45.821 INFO:teuthology.provision.fog.smithi145:Node is ready 2021-02-17T11:56:45.828 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145 2021-02-17T11:56:45.835 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2021-02-17T11:56:46.034 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2021-02-17T11:57:09.332 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-17T11:57:09.801 INFO:teuthology.provision.fog.smithi155:Node is ready 2021-02-17T11:57:09.808 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155 2021-02-17T11:57:09.815 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2021-02-17T11:57:09.988 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2021-02-17T11:57:10.148 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2021-02-17T11:57:10.149 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-17T11:57:10.165 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2021-02-17T11:57:10.166 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-17T11:57:10.181 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2021-02-17T11:57:10.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-17T11:57:10.513 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2021-02-17T11:57:10.518 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2021-02-17T11:57:10.519 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-02-17T11:57:10.519 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2021-02-17T11:57:10.519 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2021-02-17T11:57:10.520 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-02-17T11:57:10.520 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="20.04" 2021-02-17T11:57:10.521 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-17T11:57:10.521 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-17T11:57:10.521 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-17T11:57:10.521 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-17T11:57:10.522 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=focal 2021-02-17T11:57:10.522 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=focal 2021-02-17T11:57:10.523 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2021-02-17T11:57:10.539 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2021-02-17T11:57:10.540 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-17T11:57:10.715 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2021-02-17T11:57:10.722 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Ubuntu" 2021-02-17T11:57:10.722 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-02-17T11:57:10.723 INFO:teuthology.orchestra.run.smithi155.stdout:ID=ubuntu 2021-02-17T11:57:10.723 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE=debian 2021-02-17T11:57:10.723 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-02-17T11:57:10.723 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="20.04" 2021-02-17T11:57:10.724 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-17T11:57:10.724 INFO:teuthology.orchestra.run.smithi155.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-17T11:57:10.724 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-17T11:57:10.724 INFO:teuthology.orchestra.run.smithi155.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-17T11:57:10.725 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_CODENAME=focal 2021-02-17T11:57:10.725 INFO:teuthology.orchestra.run.smithi155.stdout:UBUNTU_CODENAME=focal 2021-02-17T11:57:10.725 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-02-17T11:57:10.802 INFO:teuthology.dispatcher.supervisor:Running job 5890847 2021-02-17T11:57:10.802 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2021-02-17_09:34:32-rados-wip-sseshasa-testing-2021-02-17-1300-distro-basic-smithi/5890847 --name sseshasa-2021-02-17_09:34:32-rados-wip-sseshasa-testing-2021-02-17-1300-distro-basic-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/classic} -- /home/teuthworker/archive/sseshasa-2021-02-17_09:34:32-rados-wip-sseshasa-testing-2021-02-17-1300-distro-basic-smithi/5890847/orig.config.yaml 2021-02-17T11:57:10.806 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2021-02-17_09:34:32-rados-wip-sseshasa-testing-2021-02-17-1300-distro-basic-smithi/5890847 2021-02-17T11:57:10.807 INFO:teuthology.dispatcher.supervisor:Job PID: 18337 2021-02-17T11:57:10.807 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-17T23:57:26.612 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-02-17T23:57:27.057 INFO:teuthology.kill:Killing Pids: {18337} 2021-02-17T23:57:28.278 INFO:teuthology.kill:Nuking machines: ['smithi145', 'smithi155'] 2021-02-17T23:57:29.381 INFO:teuthology.kill:2021-02-17 23:57:29,381.381 INFO:teuthology.nuke:targets: 2021-02-17T23:57:29.382 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDP7Tdtx9mqxIZNkwCuY/kpjcF+MgkFq09BGbYv4Z65aAERODIcz/OytwFqZqnBRlJ2XbK4byrLrYOuNKunKSVyVlkiUgQsYxyOMtg2ZBabwyuYCX8rgbaKivuj3JF2vtlTEFIzTlR0nbU+xS+F/myVnkFHp6aBSWpJN3Yvhwd83tGggtZEYrZeZ26kUZzaeoo/eLopetTsX8LqteLZ+O7hpyCTvjwTMvun0hyRHbn65b1B4Tjp7UdaRUr8XbLkPPWw79QnKlIZ/rhiMXCcJ0b6fhk6tNVgjRb40JuOluaBm7KO9R/3q0enrxjduz6vWQoEeN3w8ZIr4yBP8t+v/0Rfymq1qwh88Fv6wLCZgydAeaP+ayOzCbr3wJ3dB+DWygMmYuDbKutt7Gs4BW2fac8NjPyqunK9u6X7/Ksx1upu1RNEH2vWcYvUPKcT30JQHAngg1u/l2e2lU/8cKeZbR4ERPzGp+eYyPedMAdJbwWsv9bsgXCaLknlyg34fqq6mqU= 2021-02-17T23:57:29.383 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvq8+jNPckpF52/bOHMuNc+uZPrhZxQswlAn5euQ82GuXoSyahVwmhRe2DxKSSRorMKIY+no5ZuPjSqk3sR2wlWz4le+S/Lufh6hfFjfBPfZ+PM6Nehiccw2CnezGeWwsAF0KGvBmc+Z+GiPa3SB/5I4nYFUPJDAWjVkWRqPMeR5Owh0L/Y3nG+9inNJFfweL0cYf0YiiK98589L8qea1dDalGKTRtNXcWpSqE9d+NixdYVEZaYnh8xZmEcIlDAE0wKcigmE4Ho1B/v0WH1q01eKOyrFaw+ty63ChSLuQAIaF5ZFLvc6ky//jZo7bFV4vjm9doEiJqcQWl3vQ+E6Y3w8Lt00VNYl0x5+rpnV52PANGWDUCgQsThwZtzcc4PpWOf/cYGZgvtW8NUXDyzaArHz/NwfzvBX5nqcDUlgaM4Kiky1Q5Aj3s1jOayweySLrTBnc52l5W/vUdnJ5M8XudYadLL+Obglc8HSpBubLs5pJq2RxY4lFsdEHeTH1yicM= 2021-02-17T23:57:29.383 INFO:teuthology.kill:2021-02-17 23:57:29,382.382 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-17T23:57:29.391 INFO:teuthology.kill:2021-02-17 23:57:29,391.391 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-17T23:57:29.460 INFO:teuthology.kill:2021-02-17 23:57:29,459.459 INFO:teuthology.orchestra.console:Power off smithi155 2021-02-17T23:57:29.478 INFO:teuthology.kill:2021-02-17 23:57:29,478.478 INFO:teuthology.orchestra.console:Power off smithi145 2021-02-17T23:57:37.864 INFO:teuthology.kill:2021-02-17 23:57:37,863.863 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-02-17T23:57:37.878 INFO:teuthology.kill:2021-02-17 23:57:37,878.878 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2021-02-17T23:57:38.173 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-02-17T23:57:38.174 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-02-17T23:57:38.174 INFO:teuthology.misc:Compressing logs... 2021-02-17T23:57:38.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-17T23:58:38.180 ERROR:teuthology.dispatcher.supervisor:Could not save logs Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog teuth_config.archive_base, job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives compress_logs(ctx, log_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/misc.py", line 1372, in compress_logs wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/cluster.py", line 64, in return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/remote.py", line 215, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_071a4df2ce463088af781721173908ae84c1e2bd/teuthology/orchestra/run.py", line 434, in run transport = client.get_transport() AttributeError: 'NoneType' object has no attribute 'get_transport' 2021-02-17T23:58:38.240 INFO:teuthology.kill:No teuthology processes running 2021-02-17T23:58:40.286 INFO:teuthology.kill:Nuking machines: ['smithi145', 'smithi155'] 2021-02-17T23:58:41.583 INFO:teuthology.kill:2021-02-17 23:58:41,582.582 INFO:teuthology.nuke:targets: 2021-02-17T23:58:41.585 INFO:teuthology.kill: smithi145.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDP7Tdtx9mqxIZNkwCuY/kpjcF+MgkFq09BGbYv4Z65aAERODIcz/OytwFqZqnBRlJ2XbK4byrLrYOuNKunKSVyVlkiUgQsYxyOMtg2ZBabwyuYCX8rgbaKivuj3JF2vtlTEFIzTlR0nbU+xS+F/myVnkFHp6aBSWpJN3Yvhwd83tGggtZEYrZeZ26kUZzaeoo/eLopetTsX8LqteLZ+O7hpyCTvjwTMvun0hyRHbn65b1B4Tjp7UdaRUr8XbLkPPWw79QnKlIZ/rhiMXCcJ0b6fhk6tNVgjRb40JuOluaBm7KO9R/3q0enrxjduz6vWQoEeN3w8ZIr4yBP8t+v/0Rfymq1qwh88Fv6wLCZgydAeaP+ayOzCbr3wJ3dB+DWygMmYuDbKutt7Gs4BW2fac8NjPyqunK9u6X7/Ksx1upu1RNEH2vWcYvUPKcT30JQHAngg1u/l2e2lU/8cKeZbR4ERPzGp+eYyPedMAdJbwWsv9bsgXCaLknlyg34fqq6mqU= 2021-02-17T23:58:41.585 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvq8+jNPckpF52/bOHMuNc+uZPrhZxQswlAn5euQ82GuXoSyahVwmhRe2DxKSSRorMKIY+no5ZuPjSqk3sR2wlWz4le+S/Lufh6hfFjfBPfZ+PM6Nehiccw2CnezGeWwsAF0KGvBmc+Z+GiPa3SB/5I4nYFUPJDAWjVkWRqPMeR5Owh0L/Y3nG+9inNJFfweL0cYf0YiiK98589L8qea1dDalGKTRtNXcWpSqE9d+NixdYVEZaYnh8xZmEcIlDAE0wKcigmE4Ho1B/v0WH1q01eKOyrFaw+ty63ChSLuQAIaF5ZFLvc6ky//jZo7bFV4vjm9doEiJqcQWl3vQ+E6Y3w8Lt00VNYl0x5+rpnV52PANGWDUCgQsThwZtzcc4PpWOf/cYGZgvtW8NUXDyzaArHz/NwfzvBX5nqcDUlgaM4Kiky1Q5Aj3s1jOayweySLrTBnc52l5W/vUdnJ5M8XudYadLL+Obglc8HSpBubLs5pJq2RxY4lFsdEHeTH1yicM= 2021-02-17T23:58:41.617 INFO:teuthology.kill:2021-02-17 23:58:41,617.617 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-17T23:58:41.621 INFO:teuthology.kill:2021-02-17 23:58:41,621.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-17T23:58:41.695 INFO:teuthology.kill:2021-02-17 23:58:41,695.695 INFO:teuthology.orchestra.console:Power off smithi155 2021-02-17T23:58:41.715 INFO:teuthology.kill:2021-02-17 23:58:41,715.715 INFO:teuthology.orchestra.console:Power off smithi145 2021-02-17T23:58:41.876 INFO:teuthology.kill:2021-02-17 23:58:41,875.875 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-02-17T23:58:41.890 INFO:teuthology.kill:2021-02-17 23:58:41,890.890 INFO:teuthology.orchestra.console:Power off for smithi145 completed 2021-02-17T23:58:42.023 INFO:teuthology.kill:2021-02-17 23:58:42,022.022 INFO:teuthology.lock.ops:unlocked smithi155.front.sepia.ceph.com 2021-02-17T23:58:42.033 INFO:teuthology.kill:2021-02-17 23:58:42,033.033 INFO:teuthology.lock.ops:unlocked smithi145.front.sepia.ceph.com 2021-02-18T00:00:42.281 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-02-18T00:00:42.376 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-02-18T00:00:42.380 INFO:teuthology.nuke:Checking targets against current locks 2021-02-18T00:00:42.489 INFO:teuthology.nuke:Not nuking smithi155.front.sepia.ceph.com because description doesn't match 2021-02-18T00:00:42.490 INFO:teuthology.nuke:Not nuking smithi145.front.sepia.ceph.com because description doesn't match