2021-04-14T18:29:43.731 INFO:root:teuthology version: 1.1.0-2713a3cd
2021-04-14T18:29:43.928 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging
2021-04-14T18:29:43.929 INFO:teuthology.lock.ops:Updating [ubuntu@smithi059.front.sepia.ceph.com]: reset os type and version on server
2021-04-14T18:29:43.929 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2021-04-14T18:29:43.950 INFO:teuthology.lock.ops:Node 'ubuntu@smithi059.front.sepia.ceph.com' reimaging is complete
2021-04-14T18:29:43.950 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging
2021-04-14T18:29:43.951 INFO:teuthology.lock.ops:Updating [ubuntu@smithi063.front.sepia.ceph.com]: reset os type and version on server
2021-04-14T18:29:43.951 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2021-04-14T18:29:43.979 INFO:teuthology.lock.ops:Node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging is complete
2021-04-14T18:29:43.980 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi178.front.sepia.ceph.com' reimaging
2021-04-14T18:29:43.980 INFO:teuthology.lock.ops:Updating [ubuntu@smithi178.front.sepia.ceph.com]: reset os type and version on server
2021-04-14T18:29:43.980 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2021-04-14T18:29:44.001 INFO:teuthology.lock.ops:Node 'ubuntu@smithi178.front.sepia.ceph.com' reimaging is complete
2021-04-14T18:29:44.257 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.3
2021-04-14T18:29:44.269 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.3
2021-04-14T18:29:44.308 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.3
2021-04-14T18:29:44.730 INFO:teuthology.orchestra.console:Power off smithi063
2021-04-14T18:29:44.745 INFO:teuthology.orchestra.console:Power off smithi059
2021-04-14T18:29:44.835 INFO:teuthology.orchestra.console:Power off smithi178
2021-04-14T18:29:53.103 INFO:teuthology.orchestra.console:Power off for smithi063 completed
2021-04-14T18:29:53.107 INFO:teuthology.orchestra.console:Power off for smithi059 completed
2021-04-14T18:29:53.204 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2021-04-14T18:29:53.205 INFO:teuthology.orchestra.console:Power on smithi063
2021-04-14T18:29:53.211 INFO:teuthology.orchestra.console:Power on smithi059
2021-04-14T18:29:53.306 INFO:teuthology.orchestra.console:Power on smithi178
2021-04-14T18:30:01.574 INFO:teuthology.orchestra.console:Power on for smithi063 completed
2021-04-14T18:30:01.649 INFO:teuthology.orchestra.console:Power on for smithi059 completed
2021-04-14T18:30:01.672 INFO:teuthology.orchestra.console:Power on for smithi178 completed
2021-04-14T18:30:01.676 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish
2021-04-14T18:30:01.750 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2021-04-14T18:30:01.773 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2021-04-14T18:34:09.709 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-14T18:34:10.024 INFO:teuthology.provision.fog.smithi059:Node is ready
2021-04-14T18:34:10.043 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2021-04-14T18:34:10.101 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2021-04-14T18:34:10.435 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2021-04-14T18:34:32.743 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-14T18:34:42.933 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-04-14T18:34:43.236 INFO:teuthology.provision.fog.smithi063:Node is ready
2021-04-14T18:34:43.251 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com
2021-04-14T18:34:43.306 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063
2021-04-14T18:34:43.626 INFO:teuthology.provision.fog.smithi063:Deploy complete!
2021-04-14T18:34:53.142 INFO:teuthology.provision.fog.smithi178:Node is ready
2021-04-14T18:34:53.162 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2021-04-14T18:34:53.219 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2021-04-14T18:34:53.594 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2021-04-14T18:34:53.768 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2021-04-14T18:34:53.769 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-14T18:34:53.793 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com
2021-04-14T18:34:53.793 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-14T18:34:53.807 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2021-04-14T18:34:53.808 INFO:teuthology.lock.ops:New key found. Updating...
2021-04-14T18:34:53.827 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2021-04-14T18:34:53.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-14T18:34:54.126 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2021-04-14T18:34:54.182 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux"
2021-04-14T18:34:54.182 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.3 (Ootpa)"
2021-04-14T18:34:54.182 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel"
2021-04-14T18:34:54.183 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora"
2021-04-14T18:34:54.183 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.3"
2021-04-14T18:34:54.183 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2021-04-14T18:34:54.184 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-14T18:34:54.184 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2021-04-14T18:34:54.184 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-14T18:34:54.184 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/"
2021-04-14T18:34:54.185 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-14T18:34:54.185 INFO:teuthology.orchestra.run.smithi059.stdout:
2021-04-14T18:34:54.185 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-14T18:34:54.185 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-14T18:34:54.186 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-14T18:34:54.186 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-14T18:34:54.187 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2021-04-14T18:34:54.203 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server
2021-04-14T18:34:54.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-14T18:34:54.493 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64
2021-04-14T18:34:54.548 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux"
2021-04-14T18:34:54.548 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.3 (Ootpa)"
2021-04-14T18:34:54.548 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel"
2021-04-14T18:34:54.549 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora"
2021-04-14T18:34:54.549 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.3"
2021-04-14T18:34:54.549 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8"
2021-04-14T18:34:54.549 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-14T18:34:54.550 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31"
2021-04-14T18:34:54.550 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-14T18:34:54.550 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/"
2021-04-14T18:34:54.550 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-14T18:34:54.550 INFO:teuthology.orchestra.run.smithi063.stdout:
2021-04-14T18:34:54.551 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-14T18:34:54.551 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-14T18:34:54.551 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-14T18:34:54.552 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-14T18:34:54.552 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server
2021-04-14T18:34:54.567 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2021-04-14T18:34:54.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-04-14T18:34:54.788 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2021-04-14T18:34:54.843 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2021-04-14T18:34:54.844 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.3 (Ootpa)"
2021-04-14T18:34:54.844 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2021-04-14T18:34:54.844 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2021-04-14T18:34:54.844 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.3"
2021-04-14T18:34:54.845 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2021-04-14T18:34:54.845 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)"
2021-04-14T18:34:54.845 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2021-04-14T18:34:54.845 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA"
2021-04-14T18:34:54.846 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2021-04-14T18:34:54.846 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-04-14T18:34:54.846 INFO:teuthology.orchestra.run.smithi178.stdout:
2021-04-14T18:34:54.846 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-04-14T18:34:54.846 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3
2021-04-14T18:34:54.847 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-04-14T18:34:54.847 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3"
2021-04-14T18:34:54.848 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2021-04-14T18:34:54.943 INFO:teuthology.dispatcher.supervisor:Running job 6047230
2021-04-14T18:34:54.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2713a3cd31b17738a50039eaa9d859b5dc39fb8a/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/6047230 --name kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/6047230/orig.config.yaml
2021-04-14T18:34:54.947 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/6047230
2021-04-14T18:34:54.948 INFO:teuthology.dispatcher.supervisor:Job PID: 11485
2021-04-14T18:34:54.948 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-04-14T19:58:57.834 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body bgcolor="white">
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.10.3 (Ubuntu)</center>
</body>
</html>

2021-04-14T22:16:54.748 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body bgcolor="white">
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.10.3 (Ubuntu)</center>
</body>
</html>

2021-04-15T00:20:20.550 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body bgcolor="white">
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.10.3 (Ubuntu)</center>
</body>
</html>

2021-04-15T00:55:15.134 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body bgcolor="white">
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.10.3 (Ubuntu)</center>
</body>
</html>

2021-04-15T01:09:03.306 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body bgcolor="white">
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.10.3 (Ubuntu)</center>
</body>
</html>

2021-04-15T03:27:30.296 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-04-14_14:07:53-rados-wip-kefu-testing-2021-04-14-1505-distro-basic-smithi/jobs/ failed with status 504: <html>
<head><title>504 Gateway Time-out</title></head>
<body bgcolor="white">
<center><h1>504 Gateway Time-out</h1></center>
<hr><center>nginx/1.10.3 (Ubuntu)</center>
</body>
</html>

2021-04-15T04:26:36.432 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15