2021-08-04T17:07:06.675 INFO:root:teuthology version: 1.1.0-04c2febe
2021-08-04T17:07:06.807 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging
2021-08-04T17:07:06.808 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server
2021-08-04T17:07:06.809 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2021-08-04T17:07:06.826 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete
2021-08-04T17:07:06.826 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging
2021-08-04T17:07:06.827 INFO:teuthology.lock.ops:Updating [ubuntu@smithi058.front.sepia.ceph.com]: reset os type and version on server
2021-08-04T17:07:06.827 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-08-04T17:07:06.843 INFO:teuthology.lock.ops:Node 'ubuntu@smithi058.front.sepia.ceph.com' reimaging is complete
2021-08-04T17:07:06.843 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging
2021-08-04T17:07:06.844 INFO:teuthology.lock.ops:Updating [ubuntu@smithi061.front.sepia.ceph.com]: reset os type and version on server
2021-08-04T17:07:06.844 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2021-08-04T17:07:06.860 INFO:teuthology.lock.ops:Node 'ubuntu@smithi061.front.sepia.ceph.com' reimaging is complete
2021-08-04T17:07:07.051 INFO:teuthology.provision.fog.smithi061:Scheduling deploy of centos 8.stream
2021-08-04T17:07:07.056 INFO:teuthology.provision.fog.smithi058:Scheduling deploy of centos 8.stream
2021-08-04T17:07:07.059 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream
2021-08-04T17:07:07.371 INFO:teuthology.orchestra.console:Power off smithi029
2021-08-04T17:07:07.407 INFO:teuthology.orchestra.console:Power off smithi061
2021-08-04T17:07:07.445 INFO:teuthology.orchestra.console:Power off smithi058
2021-08-04T17:07:15.777 INFO:teuthology.orchestra.console:Power off for smithi061 completed
2021-08-04T17:07:15.879 INFO:teuthology.orchestra.console:Power on smithi061
2021-08-04T17:07:19.856 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2021-08-04T17:07:19.928 INFO:teuthology.orchestra.console:Power off for smithi058 completed
2021-08-04T17:07:19.958 INFO:teuthology.orchestra.console:Power on smithi029
2021-08-04T17:07:20.029 INFO:teuthology.orchestra.console:Power on smithi058
2021-08-04T17:07:24.216 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2021-08-04T17:07:24.268 INFO:teuthology.orchestra.console:Power on for smithi061 completed
2021-08-04T17:07:24.284 INFO:teuthology.orchestra.console:Power on for smithi058 completed
2021-08-04T17:07:24.318 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2021-08-04T17:07:24.369 INFO:teuthology.provision.fog.smithi061:Waiting for deploy to finish
2021-08-04T17:07:24.384 INFO:teuthology.provision.fog.smithi058:Waiting for deploy to finish
2021-08-04T17:11:32.008 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-04T17:11:32.282 INFO:teuthology.provision.fog.smithi058:Node is ready
2021-08-04T17:11:32.299 INFO:teuthology.orchestra.run.smithi058.stdout:smithi058.front.sepia.ceph.com
2021-08-04T17:11:32.355 INFO:teuthology.orchestra.run.smithi058.stdout:172.21.15.58 smithi058.front.sepia.ceph.com smithi058
2021-08-04T17:11:32.701 INFO:teuthology.provision.fog.smithi058:Deploy complete!
2021-08-04T17:11:39.717 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-04T17:11:59.680 INFO:teuthology.provision.fog.smithi061:Node is ready
2021-08-04T17:11:59.701 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061.front.sepia.ceph.com
2021-08-04T17:11:59.760 INFO:teuthology.orchestra.run.smithi061.stdout:172.21.15.61 smithi061.front.sepia.ceph.com smithi061
2021-08-04T17:12:00.133 INFO:teuthology.provision.fog.smithi061:Deploy complete!
2021-08-04T17:12:17.168 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-08-04T17:12:17.531 INFO:teuthology.provision.fog.smithi029:Node is ready
2021-08-04T17:12:17.549 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2021-08-04T17:12:17.607 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2021-08-04T17:12:17.971 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2021-08-04T17:12:18.138 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2021-08-04T17:12:18.139 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-04T17:12:18.157 INFO:teuthology.lock.ops:Checking smithi058.front.sepia.ceph.com
2021-08-04T17:12:18.157 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-04T17:12:18.171 INFO:teuthology.lock.ops:Checking smithi061.front.sepia.ceph.com
2021-08-04T17:12:18.172 INFO:teuthology.lock.ops:New key found. Updating...
2021-08-04T17:12:18.188 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2021-08-04T17:12:18.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-04T17:12:18.383 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2021-08-04T17:12:18.439 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2021-08-04T17:12:18.439 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2021-08-04T17:12:18.440 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2021-08-04T17:12:18.440 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2021-08-04T17:12:18.440 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2021-08-04T17:12:18.440 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2021-08-04T17:12:18.441 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2021-08-04T17:12:18.441 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2021-08-04T17:12:18.441 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-04T17:12:18.441 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2021-08-04T17:12:18.442 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-04T17:12:18.442 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-04T17:12:18.442 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-08-04T17:12:18.443 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2021-08-04T17:12:18.459 INFO:teuthology.lock.ops:Updating [smithi058.front.sepia.ceph.com]: set os type and version on server
2021-08-04T17:12:18.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-04T17:12:18.700 INFO:teuthology.orchestra.run.smithi058.stdout:x86_64
2021-08-04T17:12:18.757 INFO:teuthology.orchestra.run.smithi058.stdout:NAME="CentOS Stream"
2021-08-04T17:12:18.758 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION="8"
2021-08-04T17:12:18.758 INFO:teuthology.orchestra.run.smithi058.stdout:ID="centos"
2021-08-04T17:12:18.758 INFO:teuthology.orchestra.run.smithi058.stdout:ID_LIKE="rhel fedora"
2021-08-04T17:12:18.758 INFO:teuthology.orchestra.run.smithi058.stdout:VERSION_ID="8"
2021-08-04T17:12:18.759 INFO:teuthology.orchestra.run.smithi058.stdout:PLATFORM_ID="platform:el8"
2021-08-04T17:12:18.759 INFO:teuthology.orchestra.run.smithi058.stdout:PRETTY_NAME="CentOS Stream 8"
2021-08-04T17:12:18.759 INFO:teuthology.orchestra.run.smithi058.stdout:ANSI_COLOR="0;31"
2021-08-04T17:12:18.759 INFO:teuthology.orchestra.run.smithi058.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-04T17:12:18.760 INFO:teuthology.orchestra.run.smithi058.stdout:HOME_URL="https://centos.org/"
2021-08-04T17:12:18.760 INFO:teuthology.orchestra.run.smithi058.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-04T17:12:18.760 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-04T17:12:18.760 INFO:teuthology.orchestra.run.smithi058.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-08-04T17:12:18.761 INFO:teuthology.lock.ops:Updating smithi058.front.sepia.ceph.com on lock server
2021-08-04T17:12:18.778 INFO:teuthology.lock.ops:Updating [smithi061.front.sepia.ceph.com]: set os type and version on server
2021-08-04T17:12:18.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-08-04T17:12:19.069 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64
2021-08-04T17:12:19.128 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream"
2021-08-04T17:12:19.128 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8"
2021-08-04T17:12:19.128 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos"
2021-08-04T17:12:19.129 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora"
2021-08-04T17:12:19.129 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8"
2021-08-04T17:12:19.129 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8"
2021-08-04T17:12:19.129 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8"
2021-08-04T17:12:19.130 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31"
2021-08-04T17:12:19.130 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-08-04T17:12:19.130 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/"
2021-08-04T17:12:19.131 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-08-04T17:12:19.131 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-08-04T17:12:19.131 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-08-04T17:12:19.132 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server
2021-08-04T17:12:19.216 INFO:teuthology.dispatcher.supervisor:Running job 6311163
2021-08-04T17:12:19.217 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_04c2febe7099917d97a71271f17abb5710030132/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-08-04_15:28:20-rados-wip-kefu-testing2-2021-08-04-1847-distro-basic-smithi/6311163 --name kchai-2021-08-04_15:28:20-rados-wip-kefu-testing2-2021-08-04-1847-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/kchai-2021-08-04_15:28:20-rados-wip-kefu-testing2-2021-08-04-1847-distro-basic-smithi/6311163/orig.config.yaml
2021-08-04T17:12:19.220 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-08-04_15:28:20-rados-wip-kefu-testing2-2021-08-04-1847-distro-basic-smithi/6311163
2021-08-04T17:12:19.221 INFO:teuthology.dispatcher.supervisor:Job PID: 26997
2021-08-04T17:12:19.221 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-08-04T19:42:30.481 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/kchai-2021-08-04_15:28:20-rados-wip-kefu-testing2-2021-08-04-1847-distro-basic-smithi/jobs/ failed with status 500:
Internal Server Error
Internal Server Error
2021-08-05T01:42:54.631 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15