2021-02-24T15:10:23.801 INFO:root:teuthology version: 1.1.0-9a6b849c 2021-02-24T15:10:23.958 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging 2021-02-24T15:10:23.960 INFO:teuthology.lock.ops:Updating [ubuntu@smithi036.front.sepia.ceph.com]: reset os type and version on server 2021-02-24T15:10:23.960 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-02-24T15:10:23.975 INFO:teuthology.lock.ops:Node 'ubuntu@smithi036.front.sepia.ceph.com' reimaging is complete 2021-02-24T15:10:23.975 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi051.front.sepia.ceph.com' reimaging 2021-02-24T15:10:23.975 INFO:teuthology.lock.ops:Updating [ubuntu@smithi051.front.sepia.ceph.com]: reset os type and version on server 2021-02-24T15:10:23.976 INFO:teuthology.lock.ops:Updating smithi051.front.sepia.ceph.com on lock server 2021-02-24T15:10:23.990 INFO:teuthology.lock.ops:Node 'ubuntu@smithi051.front.sepia.ceph.com' reimaging is complete 2021-02-24T15:10:23.991 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging 2021-02-24T15:10:23.991 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server 2021-02-24T15:10:23.991 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2021-02-24T15:10:24.005 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete 2021-02-24T15:10:24.005 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging 2021-02-24T15:10:24.006 INFO:teuthology.lock.ops:Updating [ubuntu@smithi072.front.sepia.ceph.com]: reset os type and version on server 2021-02-24T15:10:24.006 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2021-02-24T15:10:24.022 INFO:teuthology.lock.ops:Node 'ubuntu@smithi072.front.sepia.ceph.com' reimaging is complete 2021-02-24T15:10:24.190 INFO:teuthology.provision.fog.smithi051:Scheduling deploy of rhel 8.3 2021-02-24T15:10:24.203 INFO:teuthology.provision.fog.smithi036:Scheduling deploy of rhel 8.3 2021-02-24T15:10:24.216 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of rhel 8.3 2021-02-24T15:10:24.259 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of rhel 8.3 2021-02-24T15:10:24.556 INFO:teuthology.orchestra.console:Power off smithi051 2021-02-24T15:10:24.599 INFO:teuthology.orchestra.console:Power off smithi036 2021-02-24T15:10:24.635 INFO:teuthology.orchestra.console:Power off smithi068 2021-02-24T15:10:24.694 INFO:teuthology.orchestra.console:Power off smithi072 2021-02-24T15:10:32.936 INFO:teuthology.orchestra.console:Power off for smithi051 completed 2021-02-24T15:10:32.993 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2021-02-24T15:10:33.037 INFO:teuthology.orchestra.console:Power on smithi051 2021-02-24T15:10:33.070 INFO:teuthology.orchestra.console:Power off for smithi072 completed 2021-02-24T15:10:33.096 INFO:teuthology.orchestra.console:Power on smithi068 2021-02-24T15:10:33.171 INFO:teuthology.orchestra.console:Power on smithi072 2021-02-24T15:10:37.079 INFO:teuthology.orchestra.console:Power off for smithi036 completed 2021-02-24T15:10:37.181 INFO:teuthology.orchestra.console:Power on smithi036 2021-02-24T15:10:41.405 INFO:teuthology.orchestra.console:Power on for smithi051 completed 2021-02-24T15:10:41.473 INFO:teuthology.orchestra.console:Power on for smithi068 completed 2021-02-24T15:10:41.508 INFO:teuthology.provision.fog.smithi051:Waiting for deploy to finish 2021-02-24T15:10:41.574 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish 2021-02-24T15:10:41.656 INFO:teuthology.orchestra.console:Power on for smithi072 completed 2021-02-24T15:10:41.758 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2021-02-24T15:10:45.554 INFO:teuthology.orchestra.console:Power on for smithi036 completed 2021-02-24T15:10:45.655 INFO:teuthology.provision.fog.smithi036:Waiting for deploy to finish 2021-02-24T15:14:49.256 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-24T15:14:49.547 INFO:teuthology.provision.fog.smithi051:Node is ready 2021-02-24T15:14:49.563 INFO:teuthology.orchestra.run.smithi051.stdout:smithi051.front.sepia.ceph.com 2021-02-24T15:14:49.619 INFO:teuthology.orchestra.run.smithi051.stdout:172.21.15.51 smithi051.front.sepia.ceph.com smithi051 2021-02-24T15:14:49.944 INFO:teuthology.provision.fog.smithi051:Deploy complete! 2021-02-24T15:14:53.559 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-24T15:14:53.900 INFO:teuthology.provision.fog.smithi036:Node is ready 2021-02-24T15:14:53.917 INFO:teuthology.orchestra.run.smithi036.stdout:smithi036.front.sepia.ceph.com 2021-02-24T15:14:53.978 INFO:teuthology.orchestra.run.smithi036.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2021-02-24T15:14:54.308 INFO:teuthology.provision.fog.smithi036:Deploy complete! 2021-02-24T15:15:28.678 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-24T15:15:28.981 INFO:teuthology.provision.fog.smithi068:Node is ready 2021-02-24T15:15:28.996 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com 2021-02-24T15:15:29.051 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2021-02-24T15:15:29.431 INFO:teuthology.provision.fog.smithi068:Deploy complete! 2021-02-24T15:16:23.205 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-02-24T15:16:23.511 INFO:teuthology.provision.fog.smithi072:Node is ready 2021-02-24T15:16:23.525 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2021-02-24T15:16:23.580 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2021-02-24T15:16:23.929 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2021-02-24T15:16:24.158 INFO:teuthology.lock.ops:Checking smithi036.front.sepia.ceph.com 2021-02-24T15:16:24.163 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-24T15:16:24.182 INFO:teuthology.lock.ops:Checking smithi051.front.sepia.ceph.com 2021-02-24T15:16:24.182 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-24T15:16:24.204 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com 2021-02-24T15:16:24.204 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-24T15:16:24.219 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2021-02-24T15:16:24.220 INFO:teuthology.lock.ops:New key found. Updating... 2021-02-24T15:16:24.237 INFO:teuthology.lock.ops:Updating [smithi036.front.sepia.ceph.com]: set os type and version on server 2021-02-24T15:16:24.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:16:24.579 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2021-02-24T15:16:24.634 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Red Hat Enterprise Linux" 2021-02-24T15:16:24.635 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="8.3 (Ootpa)" 2021-02-24T15:16:24.635 INFO:teuthology.orchestra.run.smithi036.stdout:ID="rhel" 2021-02-24T15:16:24.635 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE="fedora" 2021-02-24T15:16:24.635 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="8.3" 2021-02-24T15:16:24.636 INFO:teuthology.orchestra.run.smithi036.stdout:PLATFORM_ID="platform:el8" 2021-02-24T15:16:24.636 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-24T15:16:24.636 INFO:teuthology.orchestra.run.smithi036.stdout:ANSI_COLOR="0;31" 2021-02-24T15:16:24.636 INFO:teuthology.orchestra.run.smithi036.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-24T15:16:24.637 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.redhat.com/" 2021-02-24T15:16:24.637 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-24T15:16:24.637 INFO:teuthology.orchestra.run.smithi036.stdout: 2021-02-24T15:16:24.637 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-24T15:16:24.638 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-24T15:16:24.638 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-24T15:16:24.638 INFO:teuthology.orchestra.run.smithi036.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-24T15:16:24.639 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2021-02-24T15:16:24.656 INFO:teuthology.lock.ops:Updating [smithi051.front.sepia.ceph.com]: set os type and version on server 2021-02-24T15:16:24.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:16:24.955 INFO:teuthology.orchestra.run.smithi051.stdout:x86_64 2021-02-24T15:16:25.010 INFO:teuthology.orchestra.run.smithi051.stdout:NAME="Red Hat Enterprise Linux" 2021-02-24T15:16:25.010 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION="8.3 (Ootpa)" 2021-02-24T15:16:25.011 INFO:teuthology.orchestra.run.smithi051.stdout:ID="rhel" 2021-02-24T15:16:25.011 INFO:teuthology.orchestra.run.smithi051.stdout:ID_LIKE="fedora" 2021-02-24T15:16:25.011 INFO:teuthology.orchestra.run.smithi051.stdout:VERSION_ID="8.3" 2021-02-24T15:16:25.011 INFO:teuthology.orchestra.run.smithi051.stdout:PLATFORM_ID="platform:el8" 2021-02-24T15:16:25.012 INFO:teuthology.orchestra.run.smithi051.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-24T15:16:25.012 INFO:teuthology.orchestra.run.smithi051.stdout:ANSI_COLOR="0;31" 2021-02-24T15:16:25.012 INFO:teuthology.orchestra.run.smithi051.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-24T15:16:25.012 INFO:teuthology.orchestra.run.smithi051.stdout:HOME_URL="https://www.redhat.com/" 2021-02-24T15:16:25.013 INFO:teuthology.orchestra.run.smithi051.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-24T15:16:25.013 INFO:teuthology.orchestra.run.smithi051.stdout: 2021-02-24T15:16:25.013 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-24T15:16:25.013 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-24T15:16:25.013 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-24T15:16:25.014 INFO:teuthology.orchestra.run.smithi051.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-24T15:16:25.015 INFO:teuthology.lock.ops:Updating smithi051.front.sepia.ceph.com on lock server 2021-02-24T15:16:25.031 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server 2021-02-24T15:16:25.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:16:25.256 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64 2021-02-24T15:16:25.312 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="Red Hat Enterprise Linux" 2021-02-24T15:16:25.313 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="8.3 (Ootpa)" 2021-02-24T15:16:25.313 INFO:teuthology.orchestra.run.smithi068.stdout:ID="rhel" 2021-02-24T15:16:25.313 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE="fedora" 2021-02-24T15:16:25.313 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="8.3" 2021-02-24T15:16:25.314 INFO:teuthology.orchestra.run.smithi068.stdout:PLATFORM_ID="platform:el8" 2021-02-24T15:16:25.314 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-24T15:16:25.314 INFO:teuthology.orchestra.run.smithi068.stdout:ANSI_COLOR="0;31" 2021-02-24T15:16:25.314 INFO:teuthology.orchestra.run.smithi068.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-24T15:16:25.314 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://www.redhat.com/" 2021-02-24T15:16:25.315 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-24T15:16:25.315 INFO:teuthology.orchestra.run.smithi068.stdout: 2021-02-24T15:16:25.315 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-24T15:16:25.315 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-24T15:16:25.316 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-24T15:16:25.316 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-24T15:16:25.317 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2021-02-24T15:16:25.343 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2021-02-24T15:16:25.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-24T15:16:25.639 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2021-02-24T15:16:25.694 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2021-02-24T15:16:25.695 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.3 (Ootpa)" 2021-02-24T15:16:25.695 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2021-02-24T15:16:25.695 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2021-02-24T15:16:25.695 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.3" 2021-02-24T15:16:25.695 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2021-02-24T15:16:25.696 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-24T15:16:25.696 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2021-02-24T15:16:25.696 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-24T15:16:25.696 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2021-02-24T15:16:25.697 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-24T15:16:25.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2021-02-24T15:16:25.697 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-24T15:16:25.697 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-24T15:16:25.698 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-24T15:16:25.698 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-24T15:16:25.700 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2021-02-24T15:16:25.802 INFO:teuthology.dispatcher.supervisor:Running job 5909717 2021-02-24T15:16:25.803 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909717 --name sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909717/orig.config.yaml 2021-02-24T15:16:25.808 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-02-24_02:51:12-rados-wip-sage-testing-2021-02-23-1850-distro-basic-smithi/5909717 2021-02-24T15:16:25.809 INFO:teuthology.dispatcher.supervisor:Job PID: 10137 2021-02-24T15:16:25.809 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-02-24T15:32:26.212 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15