2021-04-11T03:03:26.946 INFO:root:teuthology version: 1.1.0-85d61eae 2021-04-11T03:03:27.156 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging 2021-04-11T03:03:27.157 INFO:teuthology.lock.ops:Updating [ubuntu@smithi005.front.sepia.ceph.com]: reset os type and version on server 2021-04-11T03:03:27.157 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2021-04-11T03:03:27.181 INFO:teuthology.lock.ops:Node 'ubuntu@smithi005.front.sepia.ceph.com' reimaging is complete 2021-04-11T03:03:27.182 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging 2021-04-11T03:03:27.182 INFO:teuthology.lock.ops:Updating [ubuntu@smithi039.front.sepia.ceph.com]: reset os type and version on server 2021-04-11T03:03:27.182 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2021-04-11T03:03:27.217 INFO:teuthology.lock.ops:Node 'ubuntu@smithi039.front.sepia.ceph.com' reimaging is complete 2021-04-11T03:03:27.217 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging 2021-04-11T03:03:27.217 INFO:teuthology.lock.ops:Updating [ubuntu@smithi098.front.sepia.ceph.com]: reset os type and version on server 2021-04-11T03:03:27.218 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2021-04-11T03:03:27.238 INFO:teuthology.lock.ops:Node 'ubuntu@smithi098.front.sepia.ceph.com' reimaging is complete 2021-04-11T03:03:27.238 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging 2021-04-11T03:03:27.238 INFO:teuthology.lock.ops:Updating [ubuntu@smithi167.front.sepia.ceph.com]: reset os type and version on server 2021-04-11T03:03:27.239 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2021-04-11T03:03:27.258 INFO:teuthology.lock.ops:Node 'ubuntu@smithi167.front.sepia.ceph.com' reimaging is complete 2021-04-11T03:03:27.459 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of rhel 8.3 2021-04-11T03:03:27.464 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.3 2021-04-11T03:03:27.474 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.3 2021-04-11T03:03:27.565 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.3 2021-04-11T03:03:28.208 INFO:teuthology.orchestra.console:Power off smithi039 2021-04-11T03:03:28.252 INFO:teuthology.orchestra.console:Power off smithi005 2021-04-11T03:03:28.312 INFO:teuthology.orchestra.console:Power off smithi167 2021-04-11T03:03:28.393 INFO:teuthology.orchestra.console:Power off smithi098 2021-04-11T03:03:36.617 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2021-04-11T03:03:36.719 INFO:teuthology.orchestra.console:Power on smithi005 2021-04-11T03:03:36.758 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2021-04-11T03:03:36.860 INFO:teuthology.orchestra.console:Power on smithi098 2021-04-11T03:03:40.696 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2021-04-11T03:03:40.788 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2021-04-11T03:03:40.797 INFO:teuthology.orchestra.console:Power on smithi039 2021-04-11T03:03:40.890 INFO:teuthology.orchestra.console:Power on smithi167 2021-04-11T03:03:45.049 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2021-04-11T03:03:45.078 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2021-04-11T03:03:45.137 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2021-04-11T03:03:45.151 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2021-04-11T03:03:45.179 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2021-04-11T03:03:45.219 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2021-04-11T03:03:45.238 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2021-04-11T03:03:45.320 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2021-04-11T03:08:06.937 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-11T03:08:07.259 INFO:teuthology.provision.fog.smithi005:Node is ready 2021-04-11T03:08:07.274 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2021-04-11T03:08:07.330 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2021-04-11T03:08:07.677 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2021-04-11T03:09:44.433 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-11T03:09:44.726 INFO:teuthology.provision.fog.smithi098:Node is ready 2021-04-11T03:09:44.740 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2021-04-11T03:09:44.795 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2021-04-11T03:09:45.128 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2021-04-11T03:12:00.258 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-11T03:12:00.551 INFO:teuthology.provision.fog.smithi039:Node is ready 2021-04-11T03:12:00.567 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2021-04-11T03:12:00.624 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2021-04-11T03:12:00.956 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2021-04-11T03:12:05.931 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-04-11T03:12:06.230 INFO:teuthology.provision.fog.smithi167:Node is ready 2021-04-11T03:12:06.246 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2021-04-11T03:12:06.301 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2021-04-11T03:12:06.623 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2021-04-11T03:12:06.806 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2021-04-11T03:12:06.807 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-11T03:12:06.826 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2021-04-11T03:12:06.827 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-11T03:12:06.843 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2021-04-11T03:12:06.844 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-11T03:12:06.864 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2021-04-11T03:12:06.865 INFO:teuthology.lock.ops:New key found. Updating... 2021-04-11T03:12:06.884 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2021-04-11T03:12:06.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-11T03:12:07.222 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2021-04-11T03:12:07.278 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2021-04-11T03:12:07.278 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.3 (Ootpa)" 2021-04-11T03:12:07.278 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2021-04-11T03:12:07.278 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2021-04-11T03:12:07.279 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.3" 2021-04-11T03:12:07.279 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2021-04-11T03:12:07.279 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-11T03:12:07.279 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2021-04-11T03:12:07.280 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-11T03:12:07.280 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2021-04-11T03:12:07.280 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-11T03:12:07.280 INFO:teuthology.orchestra.run.smithi005.stdout: 2021-04-11T03:12:07.281 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-11T03:12:07.281 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-11T03:12:07.281 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-11T03:12:07.282 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-11T03:12:07.283 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2021-04-11T03:12:07.300 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2021-04-11T03:12:07.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-11T03:12:07.598 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2021-04-11T03:12:07.653 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2021-04-11T03:12:07.653 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.3 (Ootpa)" 2021-04-11T03:12:07.653 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2021-04-11T03:12:07.654 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2021-04-11T03:12:07.654 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.3" 2021-04-11T03:12:07.654 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2021-04-11T03:12:07.654 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-11T03:12:07.655 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2021-04-11T03:12:07.655 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-11T03:12:07.655 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2021-04-11T03:12:07.655 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-11T03:12:07.655 INFO:teuthology.orchestra.run.smithi039.stdout: 2021-04-11T03:12:07.656 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-11T03:12:07.656 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-11T03:12:07.656 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-11T03:12:07.656 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-11T03:12:07.657 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2021-04-11T03:12:07.784 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2021-04-11T03:12:07.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-11T03:12:08.071 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2021-04-11T03:12:08.125 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2021-04-11T03:12:08.126 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.3 (Ootpa)" 2021-04-11T03:12:08.126 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2021-04-11T03:12:08.126 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2021-04-11T03:12:08.127 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.3" 2021-04-11T03:12:08.127 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2021-04-11T03:12:08.127 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-11T03:12:08.127 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2021-04-11T03:12:08.128 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-11T03:12:08.128 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2021-04-11T03:12:08.128 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-11T03:12:08.128 INFO:teuthology.orchestra.run.smithi098.stdout: 2021-04-11T03:12:08.128 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-11T03:12:08.129 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-11T03:12:08.129 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-11T03:12:08.129 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-11T03:12:08.130 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2021-04-11T03:12:08.163 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2021-04-11T03:12:08.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-04-11T03:12:08.452 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2021-04-11T03:12:08.506 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2021-04-11T03:12:08.506 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.3 (Ootpa)" 2021-04-11T03:12:08.507 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2021-04-11T03:12:08.507 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2021-04-11T03:12:08.507 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.3" 2021-04-11T03:12:08.507 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2021-04-11T03:12:08.508 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-04-11T03:12:08.508 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2021-04-11T03:12:08.508 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-04-11T03:12:08.508 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2021-04-11T03:12:08.508 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-04-11T03:12:08.509 INFO:teuthology.orchestra.run.smithi167.stdout: 2021-04-11T03:12:08.509 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-04-11T03:12:08.509 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-04-11T03:12:08.509 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-04-11T03:12:08.510 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-04-11T03:12:08.510 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2021-04-11T03:12:08.594 INFO:teuthology.dispatcher.supervisor:Running job 6033720 2021-04-11T03:12:08.594 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_85d61eae4759f46ce21e9a37cd816a7a1a66c9d5/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-04-11_03:00:38-rados-wip-kefu-testing-2021-04-10-2326-distro-basic-smithi/6033720 --name kchai-2021-04-11_03:00:38-rados-wip-kefu-testing-2021-04-10-2326-distro-basic-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/kchai-2021-04-11_03:00:38-rados-wip-kefu-testing-2021-04-10-2326-distro-basic-smithi/6033720/orig.config.yaml 2021-04-11T03:12:08.598 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-04-11_03:00:38-rados-wip-kefu-testing-2021-04-10-2326-distro-basic-smithi/6033720 2021-04-11T03:12:08.599 INFO:teuthology.dispatcher.supervisor:Job PID: 1822 2021-04-11T03:12:08.600 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-04-11T04:19:02.071 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15