2021-03-25T08:03:24.482 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-25T08:03:24.635 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging
2021-03-25T08:03:24.636 INFO:teuthology.lock.ops:Updating [ubuntu@smithi077.front.sepia.ceph.com]: reset os type and version on server
2021-03-25T08:03:24.636 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2021-03-25T08:03:24.654 INFO:teuthology.lock.ops:Node 'ubuntu@smithi077.front.sepia.ceph.com' reimaging is complete
2021-03-25T08:03:24.654 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging
2021-03-25T08:03:24.655 INFO:teuthology.lock.ops:Updating [ubuntu@smithi114.front.sepia.ceph.com]: reset os type and version on server
2021-03-25T08:03:24.655 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2021-03-25T08:03:24.670 INFO:teuthology.lock.ops:Node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging is complete
2021-03-25T08:03:24.670 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging
2021-03-25T08:03:24.670 INFO:teuthology.lock.ops:Updating [ubuntu@smithi135.front.sepia.ceph.com]: reset os type and version on server
2021-03-25T08:03:24.670 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2021-03-25T08:03:24.699 INFO:teuthology.lock.ops:Node 'ubuntu@smithi135.front.sepia.ceph.com' reimaging is complete
2021-03-25T08:03:24.699 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging
2021-03-25T08:03:24.699 INFO:teuthology.lock.ops:Updating [ubuntu@smithi171.front.sepia.ceph.com]: reset os type and version on server
2021-03-25T08:03:24.699 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2021-03-25T08:03:24.713 INFO:teuthology.lock.ops:Node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging is complete
2021-03-25T08:03:24.847 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of centos 8.3
2021-03-25T08:03:24.881 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.3
2021-03-25T08:03:24.914 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.3
2021-03-25T08:03:24.916 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 8.3
2021-03-25T08:03:25.246 INFO:teuthology.orchestra.console:Power off smithi077
2021-03-25T08:03:25.318 INFO:teuthology.orchestra.console:Power off smithi114
2021-03-25T08:03:25.353 INFO:teuthology.orchestra.console:Power off smithi135
2021-03-25T08:03:25.367 INFO:teuthology.orchestra.console:Power off smithi171
2021-03-25T08:03:33.626 INFO:teuthology.orchestra.console:Power off for smithi077 completed
2021-03-25T08:03:33.717 INFO:teuthology.orchestra.console:Power off for smithi135 completed
2021-03-25T08:03:33.727 INFO:teuthology.orchestra.console:Power on smithi077
2021-03-25T08:03:33.735 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2021-03-25T08:03:33.818 INFO:teuthology.orchestra.console:Power on smithi135
2021-03-25T08:03:33.837 INFO:teuthology.orchestra.console:Power on smithi171
2021-03-25T08:03:37.817 INFO:teuthology.orchestra.console:Power off for smithi114 completed
2021-03-25T08:03:37.919 INFO:teuthology.orchestra.console:Power on smithi114
2021-03-25T08:03:42.095 INFO:teuthology.orchestra.console:Power on for smithi077 completed
2021-03-25T08:03:42.170 INFO:teuthology.orchestra.console:Power on for smithi114 completed
2021-03-25T08:03:42.192 INFO:teuthology.orchestra.console:Power on for smithi135 completed
2021-03-25T08:03:42.196 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish
2021-03-25T08:03:42.218 INFO:teuthology.orchestra.console:Power on for smithi171 completed
2021-03-25T08:03:42.271 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish
2021-03-25T08:03:42.293 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish
2021-03-25T08:03:42.319 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish
2021-03-25T08:08:14.543 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-25T08:08:14.851 INFO:teuthology.provision.fog.smithi135:Node is ready
2021-03-25T08:08:14.865 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com
2021-03-25T08:08:14.919 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135
2021-03-25T08:08:15.243 INFO:teuthology.provision.fog.smithi135:Deploy complete!
2021-03-25T08:08:23.757 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-25T08:08:24.072 INFO:teuthology.provision.fog.smithi077:Node is ready
2021-03-25T08:08:24.086 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077.front.sepia.ceph.com
2021-03-25T08:08:24.140 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77 smithi077.front.sepia.ceph.com smithi077
2021-03-25T08:08:24.457 INFO:teuthology.provision.fog.smithi077:Deploy complete!
2021-03-25T08:08:29.639 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-25T08:08:29.773 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-03-25T08:08:29.960 INFO:teuthology.provision.fog.smithi171:Node is ready
2021-03-25T08:08:29.976 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com
2021-03-25T08:08:30.031 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171
2021-03-25T08:08:30.097 INFO:teuthology.provision.fog.smithi114:Node is ready
2021-03-25T08:08:30.111 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com
2021-03-25T08:08:30.166 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114
2021-03-25T08:08:30.347 INFO:teuthology.provision.fog.smithi171:Deploy complete!
2021-03-25T08:08:30.477 INFO:teuthology.provision.fog.smithi114:Deploy complete!
2021-03-25T08:08:30.661 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com
2021-03-25T08:08:30.661 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-25T08:08:30.677 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com
2021-03-25T08:08:30.677 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-25T08:08:30.689 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com
2021-03-25T08:08:30.690 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-25T08:08:30.705 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com
2021-03-25T08:08:30.705 INFO:teuthology.lock.ops:New key found. Updating...
2021-03-25T08:08:30.721 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server
2021-03-25T08:08:30.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T08:08:31.011 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64
2021-03-25T08:08:31.065 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Linux"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/"
2021-03-25T08:08:31.066 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-25T08:08:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-25T08:08:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-25T08:08:31.068 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server
2021-03-25T08:08:31.084 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server
2021-03-25T08:08:31.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T08:08:31.366 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Linux"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-25T08:08:31.420 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/"
2021-03-25T08:08:31.421 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-25T08:08:31.421 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-25T08:08:31.421 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-25T08:08:31.421 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server
2021-03-25T08:08:31.437 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server
2021-03-25T08:08:31.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T08:08:31.723 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64
2021-03-25T08:08:31.777 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Linux"
2021-03-25T08:08:31.777 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8"
2021-03-25T08:08:31.777 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos"
2021-03-25T08:08:31.777 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-25T08:08:31.778 INFO:teuthology.orchestra.run.smithi135.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-25T08:08:31.779 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server
2021-03-25T08:08:31.795 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server
2021-03-25T08:08:31.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-03-25T08:08:32.010 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64
2021-03-25T08:08:32.065 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Linux"
2021-03-25T08:08:32.065 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8"
2021-03-25T08:08:32.065 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos"
2021-03-25T08:08:32.065 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora"
2021-03-25T08:08:32.065 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8"
2021-03-25T08:08:32.065 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Linux 8"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.centos.org/"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8"
2021-03-25T08:08:32.066 INFO:teuthology.orchestra.run.smithi171.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8"
2021-03-25T08:08:32.066 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server
2021-03-25T08:08:32.220 INFO:teuthology.dispatcher.supervisor:Running job 5997509
2021-03-25T08:08:32.220 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-03-25_06:40:11-rados-wip-kefu-testing-2021-03-25-1305-distro-basic-smithi/5997509 --name kchai-2021-03-25_06:40:11-rados-wip-kefu-testing-2021-03-25-1305-distro-basic-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/kchai-2021-03-25_06:40:11-rados-wip-kefu-testing-2021-03-25-1305-distro-basic-smithi/5997509/orig.config.yaml
2021-03-25T08:08:32.223 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-03-25_06:40:11-rados-wip-kefu-testing-2021-03-25-1305-distro-basic-smithi/5997509
2021-03-25T08:08:32.224 INFO:teuthology.dispatcher.supervisor:Job PID: 8879
2021-03-25T08:08:32.224 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-03-25T09:42:38.621 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/kchai-2021-03-25_06:40:11-rados-wip-kefu-testing-2021-03-25-1305-distro-basic-smithi/jobs/5997509/
2021-03-25T13:02:52.865 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 498, in try_push_job_info
    push_job_info(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 463, in push_job_info
    reporter.report_job(run_name, job_id, job_info)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/teuthology/report.py", line 320, in report_job
    response.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6b3150e9e0aa7ca432e26f31d87920ebd77f3708/virtualenv/lib/python3.6/site-packages/requests/models.py", line 943, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://paddles.front.sepia.ceph.com/runs/kchai-2021-03-25_06:40:11-rados-wip-kefu-testing-2021-03-25-1305-distro-basic-smithi/jobs/5997509/
2021-03-25T13:52:56.370 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-03-25T13:52:56.619 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-03-25T13:52:56.619 INFO:teuthology.nuke:Checking targets against current locks
2021-03-25T13:52:56.697 INFO:teuthology.nuke:Not nuking smithi114.front.sepia.ceph.com because description doesn't match
2021-03-25T13:52:56.698 INFO:teuthology.nuke:Not nuking smithi135.front.sepia.ceph.com because description doesn't match
2021-03-25T13:52:56.698 INFO:teuthology.nuke:Not nuking smithi077.front.sepia.ceph.com because description doesn't match
2021-03-25T13:52:56.716 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-03-25T13:52:56.779 INFO:teuthology.orchestra.console:Power off smithi171
2021-03-25T13:52:56.922 INFO:teuthology.orchestra.console:Power off for smithi171 completed
2021-03-25T13:52:57.067 INFO:teuthology.lock.ops:unlocked smithi171.front.sepia.ceph.com