2021-03-14T03:51:30.339 INFO:root:teuthology version: 1.1.0-b9656917 2021-03-14T03:51:30.671 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging 2021-03-14T03:51:30.673 INFO:teuthology.lock.ops:Updating [ubuntu@smithi070.front.sepia.ceph.com]: reset os type and version on server 2021-03-14T03:51:30.673 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2021-03-14T03:51:30.730 INFO:teuthology.lock.ops:Node 'ubuntu@smithi070.front.sepia.ceph.com' reimaging is complete 2021-03-14T03:51:30.730 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi172.front.sepia.ceph.com' reimaging 2021-03-14T03:51:30.730 INFO:teuthology.lock.ops:Updating [ubuntu@smithi172.front.sepia.ceph.com]: reset os type and version on server 2021-03-14T03:51:30.731 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2021-03-14T03:51:30.778 INFO:teuthology.lock.ops:Node 'ubuntu@smithi172.front.sepia.ceph.com' reimaging is complete 2021-03-14T03:51:30.779 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging 2021-03-14T03:51:30.779 INFO:teuthology.lock.ops:Updating [ubuntu@smithi173.front.sepia.ceph.com]: reset os type and version on server 2021-03-14T03:51:30.779 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-03-14T03:51:30.868 INFO:teuthology.lock.ops:Node 'ubuntu@smithi173.front.sepia.ceph.com' reimaging is complete 2021-03-14T03:51:30.951 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of rhel 8.3 2021-03-14T03:51:31.016 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.3 2021-03-14T03:51:31.092 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of rhel 8.3 2021-03-14T03:51:31.510 INFO:teuthology.orchestra.console:Power off smithi172 2021-03-14T03:51:31.553 INFO:teuthology.orchestra.console:Power off smithi070 2021-03-14T03:51:31.610 INFO:teuthology.orchestra.console:Power off smithi173 2021-03-14T03:51:31.782 INFO:teuthology.orchestra.console:Power off for smithi070 completed 2021-03-14T03:51:31.886 INFO:teuthology.orchestra.console:Power on smithi070 2021-03-14T03:51:40.031 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2021-03-14T03:51:40.133 INFO:teuthology.orchestra.console:Power on smithi172 2021-03-14T03:51:40.281 INFO:teuthology.orchestra.console:Power on for smithi070 completed 2021-03-14T03:51:40.382 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2021-03-14T03:51:44.175 INFO:teuthology.orchestra.console:Power off for smithi173 completed 2021-03-14T03:51:44.277 INFO:teuthology.orchestra.console:Power on smithi173 2021-03-14T03:51:48.513 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2021-03-14T03:51:48.540 INFO:teuthology.orchestra.console:Power on for smithi173 completed 2021-03-14T03:51:48.615 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2021-03-14T03:51:48.641 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2021-03-14T03:54:12.578 ERROR:teuthology.orchestra.connection:Error authenticating with smithi070.front.sepia.ceph.com: Authentication failed. 2021-03-14T03:54:13.682 ERROR:teuthology.orchestra.connection:Error authenticating with smithi070.front.sepia.ceph.com: Authentication failed. 2021-03-14T03:56:21.359 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-14T03:56:21.670 INFO:teuthology.provision.fog.smithi173:Node is ready 2021-03-14T03:56:21.691 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2021-03-14T03:56:21.768 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2021-03-14T03:56:22.155 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2021-03-14T03:56:27.084 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-14T03:56:27.397 INFO:teuthology.provision.fog.smithi070:Node is ready 2021-03-14T03:56:27.412 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2021-03-14T03:56:27.466 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2021-03-14T03:56:27.777 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2021-03-14T03:56:45.374 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-03-14T03:56:45.679 INFO:teuthology.provision.fog.smithi172:Node is ready 2021-03-14T03:56:45.695 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2021-03-14T03:56:45.751 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2021-03-14T03:56:46.079 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2021-03-14T03:56:46.249 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2021-03-14T03:56:46.250 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-14T03:56:46.300 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2021-03-14T03:56:46.300 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-14T03:56:46.320 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2021-03-14T03:56:46.320 INFO:teuthology.lock.ops:New key found. Updating... 2021-03-14T03:56:46.336 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2021-03-14T03:56:46.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-14T03:56:46.610 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2021-03-14T03:56:46.667 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="Red Hat Enterprise Linux" 2021-03-14T03:56:46.668 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8.3 (Ootpa)" 2021-03-14T03:56:46.668 INFO:teuthology.orchestra.run.smithi070.stdout:ID="rhel" 2021-03-14T03:56:46.668 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="fedora" 2021-03-14T03:56:46.668 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8.3" 2021-03-14T03:56:46.668 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2021-03-14T03:56:46.669 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-03-14T03:56:46.669 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2021-03-14T03:56:46.669 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-03-14T03:56:46.669 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://www.redhat.com/" 2021-03-14T03:56:46.670 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-14T03:56:46.670 INFO:teuthology.orchestra.run.smithi070.stdout: 2021-03-14T03:56:46.670 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-03-14T03:56:46.670 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-03-14T03:56:46.670 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-14T03:56:46.671 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-03-14T03:56:46.673 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2021-03-14T03:56:46.688 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2021-03-14T03:56:46.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-14T03:56:46.967 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2021-03-14T03:56:47.021 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux" 2021-03-14T03:56:47.021 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.3 (Ootpa)" 2021-03-14T03:56:47.022 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel" 2021-03-14T03:56:47.022 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora" 2021-03-14T03:56:47.022 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.3" 2021-03-14T03:56:47.022 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2021-03-14T03:56:47.022 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-03-14T03:56:47.023 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2021-03-14T03:56:47.023 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-03-14T03:56:47.023 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/" 2021-03-14T03:56:47.023 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-14T03:56:47.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2021-03-14T03:56:47.024 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-03-14T03:56:47.024 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-03-14T03:56:47.025 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-14T03:56:47.025 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-03-14T03:56:47.026 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2021-03-14T03:56:47.042 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2021-03-14T03:56:47.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-14T03:56:47.336 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2021-03-14T03:56:47.390 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2021-03-14T03:56:47.391 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.3 (Ootpa)" 2021-03-14T03:56:47.391 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2021-03-14T03:56:47.391 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2021-03-14T03:56:47.391 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.3" 2021-03-14T03:56:47.392 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2021-03-14T03:56:47.392 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-03-14T03:56:47.392 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2021-03-14T03:56:47.392 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-03-14T03:56:47.393 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2021-03-14T03:56:47.393 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-03-14T03:56:47.393 INFO:teuthology.orchestra.run.smithi173.stdout: 2021-03-14T03:56:47.393 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-03-14T03:56:47.394 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-03-14T03:56:47.394 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-03-14T03:56:47.394 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-03-14T03:56:47.395 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2021-03-14T03:56:47.476 INFO:teuthology.dispatcher.supervisor:Running job 5963633 2021-03-14T03:56:47.477 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b96569170f15eae4604f361990ea65737b28dff1/virtualenv/bin/teuthology -v --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-03-14_03:49:30-rados-wip-kefu-testing-2021-03-13-1450-distro-basic-smithi/5963633 --name kchai-2021-03-14_03:49:30-rados-wip-kefu-testing-2021-03-13-1450-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/kchai-2021-03-14_03:49:30-rados-wip-kefu-testing-2021-03-13-1450-distro-basic-smithi/5963633/orig.config.yaml 2021-03-14T03:56:47.480 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/kchai-2021-03-14_03:49:30-rados-wip-kefu-testing-2021-03-13-1450-distro-basic-smithi/5963633 2021-03-14T03:56:47.481 INFO:teuthology.dispatcher.supervisor:Job PID: 3046 2021-03-14T03:56:47.481 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-03-14T04:46:48.618 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-03-14T04:46:48.787 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2021-03-14T04:46:48.787 INFO:teuthology.nuke:Checking targets against current locks 2021-03-14T04:46:48.861 INFO:teuthology.nuke:Not nuking smithi173.front.sepia.ceph.com because description doesn't match 2021-03-14T04:46:48.862 INFO:teuthology.nuke:Not nuking smithi070.front.sepia.ceph.com because description doesn't match 2021-03-14T04:46:48.863 INFO:teuthology.nuke:Not nuking smithi172.front.sepia.ceph.com because description doesn't match