2021-03-17T17:26:19.376 INFO:root:teuthology version: 1.1.0-b9656917
2021-03-17T17:26:19.480 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging
2021-03-17T17:26:19.481 INFO:teuthology.lock.ops:Updating [ubuntu@smithi122.front.sepia.ceph.com]: reset os type and version on server
2021-03-17T17:26:19.481 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2021-03-17T17:26:19.498 INFO:teuthology.lock.ops:Node 'ubuntu@smithi122.front.sepia.ceph.com' reimaging is complete
2021-03-17T17:26:19.499 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging
2021-03-17T17:26:19.499 INFO:teuthology.lock.ops:Updating [ubuntu@smithi167.front.sepia.ceph.com]: reset os type and version on server
2021-03-17T17:26:19.499 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2021-03-17T17:26:19.523 INFO:teuthology.lock.ops:Node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging is complete
2021-03-17T17:26:19.710 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of ubuntu 20.04
2021-03-17T17:26:19.734 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04
2021-03-17T17:26:20.125 INFO:teuthology.orchestra.console:Power off smithi122
2021-03-17T17:26:20.191 INFO:teuthology.orchestra.console:Power off smithi167
2021-03-17T17:26:28.521 INFO:teuthology.orchestra.console:Power off for smithi122 completed
2021-03-17T17:26:28.622 INFO:teuthology.orchestra.console:Power on smithi122
2021-03-17T17:26:32.677 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2021-03-17T17:26:32.779 INFO:teuthology.orchestra.console:Power on smithi167
2021-03-17T17:26:36.990 INFO:teuthology.orchestra.console:Power on for smithi122 completed
2021-03-17T17:26:37.028 INFO:teuthology.orchestra.console:Power on for smithi167 completed
2021-03-17T17:26:37.092 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish
2021-03-17T17:26:37.129 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2021-03-17T17:31:34.967 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-17T17:31:35.427 INFO:teuthology.provision.fog.smithi122:Node is ready
2021-03-17T17:31:35.434 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com
2021-03-17T17:31:35.487 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122
2021-03-17T17:31:35.692 INFO:teuthology.provision.fog.smithi122:Deploy complete!
2021-03-17T17:31:59.081 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-17T17:31:59.595 INFO:teuthology.provision.fog.smithi167:Node is ready
2021-03-17T17:31:59.602 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2021-03-17T17:31:59.609 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2021-03-17T17:31:59.788 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2021-03-17T17:31:59.945 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com
2021-03-17T17:31:59.946 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-17T17:31:59.961 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2021-03-17T17:31:59.962 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-17T17:31:59.976 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server
2021-03-17T17:31:59.976 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-17T17:32:00.151 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64
2021-03-17T17:32:00.201 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu"
2021-03-17T17:32:00.201 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-17T17:32:00.201 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu
2021-03-17T17:32:00.201 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian
2021-03-17T17:32:00.201 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="20.04"
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=focal
2021-03-17T17:32:00.202 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=focal
2021-03-17T17:32:00.203 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server
2021-03-17T17:32:00.218 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2021-03-17T17:32:00.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-17T17:32:00.398 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2021-03-17T17:32:00.405 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu"
2021-03-17T17:32:00.405 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-17T17:32:00.405 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu
2021-03-17T17:32:00.405 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian
2021-03-17T17:32:00.405 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04"
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal
2021-03-17T17:32:00.406 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal
2021-03-17T17:32:00.406 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2021-03-17T17:32:00.488 INFO:teuthology.dispatcher.supervisor:Running job 5973087
2021-03-17T17:32:00.489 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-17_03:31:02-rados-pacific-distro-basic-smithi/5973087 --name teuthology-2021-03-17_03:31:02-rados-pacific-distro-basic-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} -- /home/teuthworker/archive/teuthology-2021-03-17_03:31:02-rados-pacific-distro-basic-smithi/5973087/orig.config.yaml
2021-03-17T17:32:00.491 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-17_03:31:02-rados-pacific-distro-basic-smithi/5973087
2021-03-17T17:32:00.492 INFO:teuthology.dispatcher.supervisor:Job PID: 1433
2021-03-17T17:32:00.492 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-18T01:52:35.096 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-17_03:31:02-rados-pacific-distro-basic-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2021-03-18T01:52:35.189 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-17_03:31:02-rados-pacific-distro-basic-smithi/jobs/
2021-03-18T05:32:50.619 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-03-18T05:32:50.812 INFO:teuthology.kill:Killing Pids: {1433}
2021-03-18T05:32:51.941 INFO:teuthology.kill:Nuking machines: ['smithi122', 'smithi167']
2021-03-18T05:32:52.899 INFO:teuthology.kill:2021-03-18 05:32:52,898.898 INFO:teuthology.nuke:targets:
2021-03-18T05:32:52.926 INFO:teuthology.kill:  smithi122.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLUWsr+azenTTy6SC4SdsWhbX8fswha55gfBrQvIICPMy9x6FGEUsov5PajuWoOL2568DpesiRLsn0Yw1+hn1RCkqlWiklcOArPd5J+ltWsOpTLHVYT8UTewH2mhe8FlwlCScVAl56XVGHjFQL9Xe8Ob+mf3i++gNFUvqxm5TxSM2+BdaRmOGHrubIyzEFFGtej5aymL0Fiz8b4SxqG971zddAxcqK8YvFuColTiSwh+/eTHyfhDYpI/dgZ4TIMpbOPFX8M/HLv+E8tAcvsAAYCu/PcYs1VsS6XtxbimOugpkb67xntsiqgOIKntNT3OlX/4sLyH+lzfG518vQhDF0aM+xl89TCTEb1GqKmo7wImDGDWpQ/gDlC0R9JEh+jswgLmUs83q54pGVLjg7sIg64FqvwRCQ1SCZL7uV/ZzTK2E6x9LkBNgXUzU8i7Gyq3/xQouiLcaYQk3AGP9zxWNQ+sys3y74IoSMjeX7/LFEetfdqURiLo/8DTWdMhSBcPM=
2021-03-18T05:32:52.927 INFO:teuthology.kill:  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtC2HgXeq9UfY8XHk/7C9k5BiI5QG14B3IcQSsF9A6lqqNPLTiFL9sOha0bV21l04125lqQu96kacMazJ8PM6U5Y0YbEX+6aS0uX4mI3lWs0zrTsAofJW6AzZi1FfWgWP8qkLIpGXFBrRwzcul3C1tvkimEr1JY9k2Hv7v8FIBZ4AV4gPQCPN/+jdPEbxiophmv0Y8Kbjd93Rgra8kgpN9pKcCc64VVAgOiX3RZ3IsHcgA+K69dH6CQHeCiPP9ibboL1rSOZ0NURbjJb0JdIXDVz23AXRMLZfADoJxz4Ic3GeFNoWXT1lmQYoqDWteWlUaK9vfEVD5t8/3tfnArTzdrk6GundWSSuWhGw1T8Ga2lSkIhotQBKzFhvhJa+/JB+szwtbZ4VLluOpcKqcS9cfIVDiRJlIws5lbHiNBlg+87fzRVnIfeiNOxEH2OxTK/S8gfZiFPH5DJMDEywYg1KcvzaI7KHqjHeczLTjDImyFEoci2CV7Quza1VjOeyt10c=
2021-03-18T05:32:52.927 INFO:teuthology.kill:2021-03-18 05:32:52,899.899 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-18T05:32:52.927 INFO:teuthology.kill:2021-03-18 05:32:52,901.901 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-18T05:32:52.972 INFO:teuthology.kill:2021-03-18 05:32:52,972.972 INFO:teuthology.orchestra.console:Power off smithi167
2021-03-18T05:32:52.987 INFO:teuthology.kill:2021-03-18 05:32:52,987.987 INFO:teuthology.orchestra.console:Power off smithi122
2021-03-18T05:33:01.372 INFO:teuthology.kill:2021-03-18 05:33:01,372.372 INFO:teuthology.orchestra.console:Power off for smithi122 completed
2021-03-18T05:33:01.381 INFO:teuthology.kill:2021-03-18 05:33:01,378.378 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2021-03-18T05:33:01.612 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a']
2021-03-18T05:33:01.612 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b']
2021-03-18T05:33:01.612 INFO:teuthology.misc:Compressing logs...
2021-03-18T05:33:01.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-18T05:34:01.675 ERROR:teuthology.dispatcher.supervisor:Could not save logs
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 231, in run_with_watchdog
    teuth_config.archive_base, job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/dispatcher/supervisor.py", line 289, in transfer_archives
    compress_logs(ctx, log_path)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/misc.py", line 1374, in compress_logs
    wait=False,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/cluster.py", line 64, in <listcomp>
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/teuthology/orchestra/run.py", line 434, in run
    transport = client.get_transport()
AttributeError: 'NoneType' object has no attribute 'get_transport'
2021-03-18T05:34:01.717 INFO:teuthology.kill:No teuthology processes running
2021-03-18T05:34:02.780 INFO:teuthology.kill:Nuking machines: ['smithi122', 'smithi167']
2021-03-18T05:34:03.742 INFO:teuthology.kill:2021-03-18 05:34:03,742.742 INFO:teuthology.nuke:targets:
2021-03-18T05:34:03.742 INFO:teuthology.kill:  smithi122.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLUWsr+azenTTy6SC4SdsWhbX8fswha55gfBrQvIICPMy9x6FGEUsov5PajuWoOL2568DpesiRLsn0Yw1+hn1RCkqlWiklcOArPd5J+ltWsOpTLHVYT8UTewH2mhe8FlwlCScVAl56XVGHjFQL9Xe8Ob+mf3i++gNFUvqxm5TxSM2+BdaRmOGHrubIyzEFFGtej5aymL0Fiz8b4SxqG971zddAxcqK8YvFuColTiSwh+/eTHyfhDYpI/dgZ4TIMpbOPFX8M/HLv+E8tAcvsAAYCu/PcYs1VsS6XtxbimOugpkb67xntsiqgOIKntNT3OlX/4sLyH+lzfG518vQhDF0aM+xl89TCTEb1GqKmo7wImDGDWpQ/gDlC0R9JEh+jswgLmUs83q54pGVLjg7sIg64FqvwRCQ1SCZL7uV/ZzTK2E6x9LkBNgXUzU8i7Gyq3/xQouiLcaYQk3AGP9zxWNQ+sys3y74IoSMjeX7/LFEetfdqURiLo/8DTWdMhSBcPM=
2021-03-18T05:34:03.743 INFO:teuthology.kill:  smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtC2HgXeq9UfY8XHk/7C9k5BiI5QG14B3IcQSsF9A6lqqNPLTiFL9sOha0bV21l04125lqQu96kacMazJ8PM6U5Y0YbEX+6aS0uX4mI3lWs0zrTsAofJW6AzZi1FfWgWP8qkLIpGXFBrRwzcul3C1tvkimEr1JY9k2Hv7v8FIBZ4AV4gPQCPN/+jdPEbxiophmv0Y8Kbjd93Rgra8kgpN9pKcCc64VVAgOiX3RZ3IsHcgA+K69dH6CQHeCiPP9ibboL1rSOZ0NURbjJb0JdIXDVz23AXRMLZfADoJxz4Ic3GeFNoWXT1lmQYoqDWteWlUaK9vfEVD5t8/3tfnArTzdrk6GundWSSuWhGw1T8Ga2lSkIhotQBKzFhvhJa+/JB+szwtbZ4VLluOpcKqcS9cfIVDiRJlIws5lbHiNBlg+87fzRVnIfeiNOxEH2OxTK/S8gfZiFPH5DJMDEywYg1KcvzaI7KHqjHeczLTjDImyFEoci2CV7Quza1VjOeyt10c=
2021-03-18T05:34:03.762 INFO:teuthology.kill:2021-03-18 05:34:03,762.762 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-18T05:34:03.766 INFO:teuthology.kill:2021-03-18 05:34:03,766.766 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-18T05:34:03.824 INFO:teuthology.kill:2021-03-18 05:34:03,824.824 INFO:teuthology.orchestra.console:Power off smithi122
2021-03-18T05:34:03.839 INFO:teuthology.kill:2021-03-18 05:34:03,839.839 INFO:teuthology.orchestra.console:Power off smithi167
2021-03-18T05:34:03.970 INFO:teuthology.kill:2021-03-18 05:34:03,969.969 INFO:teuthology.orchestra.console:Power off for smithi122 completed
2021-03-18T05:34:03.982 INFO:teuthology.kill:2021-03-18 05:34:03,982.982 INFO:teuthology.orchestra.console:Power off for smithi167 completed
2021-03-18T05:34:04.110 INFO:teuthology.kill:2021-03-18 05:34:04,109.109 INFO:teuthology.lock.ops:unlocked smithi122.front.sepia.ceph.com
2021-03-18T05:34:04.124 INFO:teuthology.kill:2021-03-18 05:34:04,124.124 INFO:teuthology.lock.ops:unlocked smithi167.front.sepia.ceph.com
2021-03-18T05:36:04.424 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-18T05:36:04.496 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-18T05:36:04.497 INFO:teuthology.nuke:Checking targets against current locks
2021-03-18T05:36:04.602 INFO:teuthology.nuke:Not nuking smithi167.front.sepia.ceph.com because description doesn't match
2021-03-18T05:36:04.602 INFO:teuthology.nuke:Not nuking smithi122.front.sepia.ceph.com because description doesn't match