2021-03-22T13:06:11.611 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-22T13:06:11.743 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging
2021-03-22T13:06:11.743 INFO:teuthology.lock.ops:Updating [ubuntu@smithi066.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T13:06:11.743 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2021-03-22T13:06:11.757 INFO:teuthology.lock.ops:Node 'ubuntu@smithi066.front.sepia.ceph.com' reimaging is complete
2021-03-22T13:06:11.757 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging
2021-03-22T13:06:11.758 INFO:teuthology.lock.ops:Updating [ubuntu@smithi074.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T13:06:11.758 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server
2021-03-22T13:06:11.772 INFO:teuthology.lock.ops:Node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging is complete
2021-03-22T13:06:11.772 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging
2021-03-22T13:06:11.772 INFO:teuthology.lock.ops:Updating [ubuntu@smithi169.front.sepia.ceph.com]: reset os type and version on server
2021-03-22T13:06:11.772 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2021-03-22T13:06:11.788 INFO:teuthology.lock.ops:Node 'ubuntu@smithi169.front.sepia.ceph.com' reimaging is complete
2021-03-22T13:06:11.967 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of ubuntu 20.04
2021-03-22T13:06:11.980 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of ubuntu 20.04
2021-03-22T13:06:12.005 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 20.04
2021-03-22T13:06:12.275 INFO:teuthology.orchestra.console:Power off smithi066
2021-03-22T13:06:12.293 INFO:teuthology.orchestra.console:Power off smithi074
2021-03-22T13:06:12.327 INFO:teuthology.orchestra.console:Power off smithi169
2021-03-22T13:06:24.805 INFO:teuthology.orchestra.console:Power off for smithi066 completed
2021-03-22T13:06:24.809 INFO:teuthology.orchestra.console:Power off for smithi074 completed
2021-03-22T13:06:24.815 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2021-03-22T13:06:24.906 INFO:teuthology.orchestra.console:Power on smithi066
2021-03-22T13:06:24.914 INFO:teuthology.orchestra.console:Power on smithi074
2021-03-22T13:06:24.921 INFO:teuthology.orchestra.console:Power on smithi169
2021-03-22T13:06:29.184 INFO:teuthology.orchestra.console:Power on for smithi074 completed
2021-03-22T13:06:29.285 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish
2021-03-22T13:06:33.298 INFO:teuthology.orchestra.console:Power on for smithi066 completed
2021-03-22T13:06:33.304 INFO:teuthology.orchestra.console:Power on for smithi169 completed
2021-03-22T13:06:33.399 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2021-03-22T13:06:33.405 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2021-03-22T13:11:33.085 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T13:11:33.632 INFO:teuthology.provision.fog.smithi074:Node is ready
2021-03-22T13:11:33.639 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com
2021-03-22T13:11:33.646 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074
2021-03-22T13:11:33.800 INFO:teuthology.provision.fog.smithi074:Deploy complete!
2021-03-22T13:11:33.946 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T13:11:34.404 INFO:teuthology.provision.fog.smithi066:Node is ready
2021-03-22T13:11:34.411 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2021-03-22T13:11:34.464 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2021-03-22T13:11:34.606 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2021-03-22T13:11:39.901 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-22T13:11:40.432 INFO:teuthology.provision.fog.smithi169:Node is ready
2021-03-22T13:11:40.578 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2021-03-22T13:11:40.625 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2021-03-22T13:11:40.808 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2021-03-22T13:11:41.081 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2021-03-22T13:11:41.082 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T13:11:41.106 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com
2021-03-22T13:11:41.106 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T13:11:41.120 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2021-03-22T13:11:41.120 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-22T13:11:41.149 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2021-03-22T13:11:41.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T13:11:41.342 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2021-03-22T13:11:41.350 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu"
2021-03-22T13:11:41.350 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-22T13:11:41.350 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu
2021-03-22T13:11:41.350 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian
2021-03-22T13:11:41.350 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-22T13:11:41.350 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="20.04"
2021-03-22T13:11:41.351 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-22T13:11:41.351 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-22T13:11:41.351 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-22T13:11:41.351 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-22T13:11:41.351 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=focal
2021-03-22T13:11:41.351 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=focal
2021-03-22T13:11:41.352 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2021-03-22T13:11:41.368 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server
2021-03-22T13:11:41.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T13:11:41.600 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64
2021-03-22T13:11:41.614 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="Ubuntu"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:ID=ubuntu
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE=debian
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="20.04"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_CODENAME=focal
2021-03-22T13:11:41.615 INFO:teuthology.orchestra.run.smithi074.stdout:UBUNTU_CODENAME=focal
2021-03-22T13:11:41.616 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server
2021-03-22T13:11:41.639 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2021-03-22T13:11:41.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-22T13:11:41.819 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu"
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="20.04.2 LTS (Focal Fossa)"
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS"
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="20.04"
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/"
2021-03-22T13:11:41.869 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2021-03-22T13:11:41.870 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2021-03-22T13:11:41.870 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2021-03-22T13:11:41.870 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=focal
2021-03-22T13:11:41.870 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=focal
2021-03-22T13:11:41.870 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2021-03-22T13:11:41.981 INFO:teuthology.dispatcher.supervisor:Running job 5987440
2021-03-22T13:11:41.982 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/5987440 --name teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi --description fs/workload/{begin clusters/1a5s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/5 scrub/yes tasks/{0-check-counter workunit/fs/misc}} -- /home/teuthworker/archive/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/5987440/orig.config.yaml
2021-03-22T13:11:41.986 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/5987440
2021-03-22T13:11:41.987 INFO:teuthology.dispatcher.supervisor:Job PID: 7225
2021-03-22T13:11:41.987 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-22T15:55:45.502 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/5987440/
2021-03-22T17:35:47.635 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/5987440/
2021-03-22T17:39:47.752 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/5987440/
2021-03-22T20:07:50.847 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/5987440/
2021-03-22T21:25:52.461 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/ failed with status 500: <html>
  <head>
    <title>Internal Server Error</title>
  </head>
  <body>
    <h1><p>Internal Server Error</p></h1>
    
  </body>
</html>

2021-03-22T21:25:52.461 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/
2021-03-22T22:01:53.191 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/teuthology-2021-03-22_04:17:03-fs-pacific-distro-basic-smithi/jobs/5987440/
2021-03-22T22:31:53.922 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-22T22:31:54.140 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-22T22:31:54.141 INFO:teuthology.nuke:Checking targets against current locks
2021-03-22T22:31:54.214 INFO:teuthology.nuke:Not nuking smithi074.front.sepia.ceph.com because description doesn't match
2021-03-22T22:31:54.214 INFO:teuthology.nuke:Not nuking smithi066.front.sepia.ceph.com because description doesn't match
2021-03-22T22:31:54.233 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-22T22:31:54.285 INFO:teuthology.orchestra.console:Power off smithi169
2021-03-22T22:31:54.427 INFO:teuthology.orchestra.console:Power off for smithi169 completed
2021-03-22T22:31:54.569 INFO:teuthology.lock.ops:unlocked smithi169.front.sepia.ceph.com