2021-07-29T09:15:08.813 INFO:root:teuthology version: 1.1.0-73aa7e3b
2021-07-29T09:15:08.959 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging
2021-07-29T09:15:08.960 INFO:teuthology.lock.ops:Updating [ubuntu@smithi037.front.sepia.ceph.com]: reset os type and version on server
2021-07-29T09:15:08.961 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2021-07-29T09:15:08.985 INFO:teuthology.lock.ops:Node 'ubuntu@smithi037.front.sepia.ceph.com' reimaging is complete
2021-07-29T09:15:08.985 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging
2021-07-29T09:15:08.986 INFO:teuthology.lock.ops:Updating [ubuntu@smithi085.front.sepia.ceph.com]: reset os type and version on server
2021-07-29T09:15:08.986 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2021-07-29T09:15:09.007 INFO:teuthology.lock.ops:Node 'ubuntu@smithi085.front.sepia.ceph.com' reimaging is complete
2021-07-29T09:15:09.008 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging
2021-07-29T09:15:09.009 INFO:teuthology.lock.ops:Updating [ubuntu@smithi119.front.sepia.ceph.com]: reset os type and version on server
2021-07-29T09:15:09.009 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2021-07-29T09:15:09.033 INFO:teuthology.lock.ops:Node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging is complete
2021-07-29T09:15:09.195 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of centos 8.stream
2021-07-29T09:15:09.221 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of centos 8.stream
2021-07-29T09:15:09.233 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 8.stream
2021-07-29T09:15:09.491 INFO:teuthology.orchestra.console:Power off smithi037
2021-07-29T09:15:09.537 INFO:teuthology.orchestra.console:Power off smithi085
2021-07-29T09:15:09.555 INFO:teuthology.orchestra.console:Power off smithi119
2021-07-29T09:15:17.918 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2021-07-29T09:15:17.927 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2021-07-29T09:15:18.021 INFO:teuthology.orchestra.console:Power on smithi085
2021-07-29T09:15:18.031 INFO:teuthology.orchestra.console:Power on smithi119
2021-07-29T09:15:22.006 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-07-29T09:15:22.108 INFO:teuthology.orchestra.console:Power on smithi037
2021-07-29T09:15:26.365 INFO:teuthology.orchestra.console:Power on for smithi037 completed
2021-07-29T09:15:26.393 INFO:teuthology.orchestra.console:Power on for smithi085 completed
2021-07-29T09:15:26.401 INFO:teuthology.orchestra.console:Power on for smithi119 completed
2021-07-29T09:15:26.467 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish
2021-07-29T09:15:26.494 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish
2021-07-29T09:15:26.502 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2021-07-29T09:19:32.864 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-29T09:19:34.095 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-29T09:19:34.524 INFO:teuthology.provision.fog.smithi037:Node is ready
2021-07-29T09:19:34.547 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com
2021-07-29T09:19:34.606 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037
2021-07-29T09:19:34.961 INFO:teuthology.provision.fog.smithi037:Deploy complete!
2021-07-29T09:19:53.302 INFO:teuthology.provision.fog.smithi119:Node is ready
2021-07-29T09:19:53.324 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2021-07-29T09:19:53.384 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2021-07-29T09:19:53.748 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2021-07-29T09:19:58.281 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-07-29T09:19:58.562 INFO:teuthology.provision.fog.smithi085:Node is ready
2021-07-29T09:19:58.581 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com
2021-07-29T09:19:58.639 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085
2021-07-29T09:19:58.993 INFO:teuthology.provision.fog.smithi085:Deploy complete!
2021-07-29T09:19:59.193 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com
2021-07-29T09:19:59.194 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-29T09:19:59.212 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com
2021-07-29T09:19:59.212 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-29T09:19:59.228 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2021-07-29T09:19:59.228 INFO:teuthology.lock.ops:New key found. Updating...
2021-07-29T09:19:59.246 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server
2021-07-29T09:19:59.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-29T09:19:59.541 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64
2021-07-29T09:19:59.601 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream"
2021-07-29T09:19:59.601 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8"
2021-07-29T09:19:59.602 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos"
2021-07-29T09:19:59.602 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora"
2021-07-29T09:19:59.602 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8"
2021-07-29T09:19:59.602 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8"
2021-07-29T09:19:59.603 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-29T09:19:59.603 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31"
2021-07-29T09:19:59.603 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-29T09:19:59.603 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/"
2021-07-29T09:19:59.603 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-29T09:19:59.604 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-29T09:19:59.604 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-29T09:19:59.605 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server
2021-07-29T09:19:59.623 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server
2021-07-29T09:19:59.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-29T09:19:59.853 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64
2021-07-29T09:19:59.909 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream"
2021-07-29T09:19:59.910 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8"
2021-07-29T09:19:59.910 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos"
2021-07-29T09:19:59.910 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora"
2021-07-29T09:19:59.910 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8"
2021-07-29T09:19:59.911 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8"
2021-07-29T09:19:59.911 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-29T09:19:59.911 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31"
2021-07-29T09:19:59.911 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-29T09:19:59.912 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/"
2021-07-29T09:19:59.912 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-29T09:19:59.912 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-29T09:19:59.912 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-29T09:19:59.913 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server
2021-07-29T09:19:59.932 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2021-07-29T09:19:59.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host
2021-07-29T09:20:00.133 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2021-07-29T09:20:00.191 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream"
2021-07-29T09:20:00.191 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8"
2021-07-29T09:20:00.192 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos"
2021-07-29T09:20:00.192 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora"
2021-07-29T09:20:00.192 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8"
2021-07-29T09:20:00.192 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2021-07-29T09:20:00.192 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 8"
2021-07-29T09:20:00.193 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2021-07-29T09:20:00.193 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-07-29T09:20:00.193 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/"
2021-07-29T09:20:00.193 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-07-29T09:20:00.194 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-07-29T09:20:00.194 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-07-29T09:20:00.195 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2021-07-29T09:20:00.321 INFO:teuthology.dispatcher.supervisor:Running job 6300959
2021-07-29T09:20:00.322 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_73aa7e3b960c7ffac669297b6aa86606265edd1b/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi/6300959 --name kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8.stream} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi/6300959/orig.config.yaml
2021-07-29T09:20:00.326 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-07-29_08:05:42-rados-wip-kefu-testing-2021-07-29-1336-distro-basic-smithi/6300959
2021-07-29T09:20:00.328 INFO:teuthology.dispatcher.supervisor:Job PID: 15330
2021-07-29T09:20:00.328 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-07-29T16:34:31.925 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-07-29T16:34:32.102 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-07-29T16:34:32.103 INFO:teuthology.nuke:Checking targets against current locks
2021-07-29T16:34:32.231 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-29T16:34:32.235 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-29T16:34:32.239 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-07-29T16:34:32.288 INFO:teuthology.orchestra.console:Power off smithi085
2021-07-29T16:34:32.304 INFO:teuthology.orchestra.console:Power off smithi119
2021-07-29T16:34:32.318 INFO:teuthology.orchestra.console:Power off smithi037
2021-07-29T16:34:44.788 INFO:teuthology.orchestra.console:Power off for smithi119 completed
2021-07-29T16:34:44.795 INFO:teuthology.orchestra.console:Power off for smithi085 completed
2021-07-29T16:34:44.801 INFO:teuthology.orchestra.console:Power off for smithi037 completed
2021-07-29T16:34:44.927 ERROR:teuthology.lock.ops:failed to unlock smithi085.front.sepia.ceph.com. reason: Cannot unlock - locked_by values must match
2021-07-29T16:34:44.929 INFO:teuthology.lock.ops:unlocked smithi119.front.sepia.ceph.com
2021-07-29T16:34:44.931 ERROR:teuthology.lock.ops:failed to unlock smithi037.front.sepia.ceph.com. reason: Cannot unlock an already-unlocked node