2021-03-24T21:55:38.688 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-24T21:55:38.736 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/sage-2021-03-24_21:26:22-rados:cephadm-wip-sage2-testing-2021-03-24-1043-pacific-distro-basic-smithi/jobs/5995108/
2021-03-24T21:55:38.825 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging
2021-03-24T21:55:38.826 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server
2021-03-24T21:55:38.826 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2021-03-24T21:55:38.844 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete
2021-03-24T21:55:38.845 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging
2021-03-24T21:55:38.845 INFO:teuthology.lock.ops:Updating [ubuntu@smithi119.front.sepia.ceph.com]: reset os type and version on server
2021-03-24T21:55:38.846 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2021-03-24T21:55:38.866 INFO:teuthology.lock.ops:Node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging is complete
2021-03-24T21:55:38.867 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging
2021-03-24T21:55:38.867 INFO:teuthology.lock.ops:Updating [ubuntu@smithi195.front.sepia.ceph.com]: reset os type and version on server
2021-03-24T21:55:38.868 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2021-03-24T21:55:38.886 INFO:teuthology.lock.ops:Node 'ubuntu@smithi195.front.sepia.ceph.com' reimaging is complete
2021-03-24T21:55:39.146 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of ubuntu 18.04
2021-03-24T21:55:39.204 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of ubuntu 18.04
2021-03-24T21:55:39.210 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 18.04
2021-03-24T21:55:39.742 INFO:teuthology.orchestra.console:Power off smithi029
2021-03-24T21:55:39.820 INFO:teuthology.orchestra.console:Power off smithi195
2021-03-24T21:55:39.876 INFO:teuthology.orchestra.console:Power off smithi119
2021-03-24T21:55:48.117 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2021-03-24T21:55:48.206 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2021-03-24T21:55:48.218 INFO:teuthology.orchestra.console:Power on smithi029
2021-03-24T21:55:48.307 INFO:teuthology.orchestra.console:Power on smithi195
2021-03-24T21:55:52.355 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2021-03-24T21:55:52.456 INFO:teuthology.orchestra.console:Power on smithi119
2021-03-24T21:55:52.472 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2021-03-24T21:55:52.574 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2021-03-24T21:55:56.678 INFO:teuthology.orchestra.console:Power on for smithi195 completed
2021-03-24T21:55:56.779 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2021-03-24T21:56:00.822 INFO:teuthology.orchestra.console:Power on for smithi119 completed
2021-03-24T21:56:00.923 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2021-03-24T22:00:29.830 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2021-03-24T22:00:36.078 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-24T22:00:36.415 INFO:teuthology.provision.fog.smithi195:Node is ready
2021-03-24T22:00:36.465 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com
2021-03-24T22:00:36.513 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195
2021-03-24T22:00:36.864 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2021-03-24T22:00:49.958 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-24T22:00:50.328 INFO:teuthology.provision.fog.smithi119:Node is ready
2021-03-24T22:00:50.378 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2021-03-24T22:00:50.431 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2021-03-24T22:00:50.717 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2021-03-24T22:01:22.381 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-24T22:01:22.808 INFO:teuthology.provision.fog.smithi029:Node is ready
2021-03-24T22:01:22.858 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2021-03-24T22:01:22.906 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2021-03-24T22:01:23.261 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2021-03-24T22:01:23.497 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2021-03-24T22:01:23.498 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-24T22:01:23.514 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2021-03-24T22:01:23.515 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-24T22:01:23.527 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com
2021-03-24T22:01:23.528 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-24T22:01:23.546 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2021-03-24T22:01:23.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-24T22:01:23.844 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2021-03-24T22:01:23.893 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Ubuntu"
2021-03-24T22:01:23.894 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-24T22:01:23.894 INFO:teuthology.orchestra.run.smithi029.stdout:ID=ubuntu
2021-03-24T22:01:23.895 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE=debian
2021-03-24T22:01:23.895 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-24T22:01:23.896 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="18.04"
2021-03-24T22:01:23.896 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-24T22:01:23.897 INFO:teuthology.orchestra.run.smithi029.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-24T22:01:23.897 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-24T22:01:23.897 INFO:teuthology.orchestra.run.smithi029.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-24T22:01:23.898 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_CODENAME=bionic
2021-03-24T22:01:23.898 INFO:teuthology.orchestra.run.smithi029.stdout:UBUNTU_CODENAME=bionic
2021-03-24T22:01:23.900 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2021-03-24T22:01:23.918 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2021-03-24T22:01:23.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-24T22:01:24.286 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2021-03-24T22:01:24.334 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu"
2021-03-24T22:01:24.334 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-24T22:01:24.335 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu
2021-03-24T22:01:24.335 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian
2021-03-24T22:01:24.335 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-24T22:01:24.335 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="18.04"
2021-03-24T22:01:24.336 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-24T22:01:24.336 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-24T22:01:24.336 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-24T22:01:24.336 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-24T22:01:24.336 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=bionic
2021-03-24T22:01:24.337 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=bionic
2021-03-24T22:01:24.337 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2021-03-24T22:01:24.355 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server
2021-03-24T22:01:24.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-24T22:01:24.716 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64
2021-03-24T22:01:24.764 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Ubuntu"
2021-03-24T22:01:24.764 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="18.04.5 LTS (Bionic Beaver)"
2021-03-24T22:01:24.765 INFO:teuthology.orchestra.run.smithi195.stdout:ID=ubuntu
2021-03-24T22:01:24.765 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE=debian
2021-03-24T22:01:24.765 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS"
2021-03-24T22:01:24.765 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="18.04"
2021-03-24T22:01:24.766 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-24T22:01:24.766 INFO:teuthology.orchestra.run.smithi195.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-24T22:01:24.766 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-24T22:01:24.766 INFO:teuthology.orchestra.run.smithi195.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-24T22:01:24.767 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_CODENAME=bionic
2021-03-24T22:01:24.767 INFO:teuthology.orchestra.run.smithi195.stdout:UBUNTU_CODENAME=bionic
2021-03-24T22:01:24.767 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2021-03-24T22:01:24.850 INFO:teuthology.dispatcher.supervisor:Running job 5995108
2021-03-24T22:01:24.851 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-03-24_21:26:22-rados:cephadm-wip-sage2-testing-2021-03-24-1043-pacific-distro-basic-smithi/5995108 --name sage-2021-03-24_21:26:22-rados:cephadm-wip-sage2-testing-2021-03-24-1043-pacific-distro-basic-smithi --description rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/sage-2021-03-24_21:26:22-rados:cephadm-wip-sage2-testing-2021-03-24-1043-pacific-distro-basic-smithi/5995108/orig.config.yaml
2021-03-24T22:01:24.855 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-03-24_21:26:22-rados:cephadm-wip-sage2-testing-2021-03-24-1043-pacific-distro-basic-smithi/5995108
2021-03-24T22:01:24.856 INFO:teuthology.dispatcher.supervisor:Job PID: 29202
2021-03-24T22:01:24.856 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-24T22:07:25.283 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-24T22:07:25.440 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-24T22:07:25.440 INFO:teuthology.nuke:Checking targets against current locks
2021-03-24T22:07:25.554 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T22:07:25.558 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T22:07:25.560 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-24T22:07:25.627 INFO:teuthology.orchestra.console:Power off smithi195
2021-03-24T22:07:25.641 INFO:teuthology.orchestra.console:Power off smithi029
2021-03-24T22:07:25.653 INFO:teuthology.orchestra.console:Power off smithi119
2021-03-24T22:07:34.012 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2021-03-24T22:07:34.018 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2021-03-24T22:07:34.144 ERROR:teuthology.lock.ops:failed to unlock smithi195.front.sepia.ceph.com. reason: 500
2021-03-24T22:07:34.148 ERROR:teuthology.lock.ops:failed to unlock smithi029.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node
2021-03-24T22:07:38.137 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2021-03-24T22:07:38.267 ERROR:teuthology.lock.ops:failed to unlock smithi119.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node