2022-03-28T11:52:37.175 INFO:root:teuthology version: 1.1.0-70390753
2022-03-28T11:52:37.294 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging
2022-03-28T11:52:37.295 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server
2022-03-28T11:52:37.295 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2022-03-28T11:52:37.313 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete
2022-03-28T11:52:37.313 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging
2022-03-28T11:52:37.314 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server
2022-03-28T11:52:37.314 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2022-03-28T11:52:37.332 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete
2022-03-28T11:52:37.538 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of rhel 8.4
2022-03-28T11:52:37.541 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.4
2022-03-28T11:52:37.854 INFO:teuthology.orchestra.console:Power off smithi163
2022-03-28T11:52:37.867 INFO:teuthology.orchestra.console:Power off smithi155
2022-03-28T11:52:37.994 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2022-03-28T11:52:38.006 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2022-03-28T11:52:38.096 INFO:teuthology.orchestra.console:Power on smithi163
2022-03-28T11:52:38.108 INFO:teuthology.orchestra.console:Power on smithi155
2022-03-28T11:52:46.459 INFO:teuthology.orchestra.console:Power on for smithi163 completed
2022-03-28T11:52:46.464 INFO:teuthology.orchestra.console:Power on for smithi155 completed
2022-03-28T11:52:46.561 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish
2022-03-28T11:52:46.565 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2022-03-28T11:55:17.811 ERROR:teuthology.orchestra.connection:Error authenticating with smithi155.front.sepia.ceph.com: Authentication failed.
2022-03-28T11:57:34.818 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-28T11:57:35.051 INFO:teuthology.provision.fog.smithi155:Node is ready
2022-03-28T11:57:35.066 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2022-03-28T11:57:35.122 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2022-03-28T11:57:35.449 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2022-03-28T11:58:12.797 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-03-28T11:58:12.997 INFO:teuthology.provision.fog.smithi163:Node is ready
2022-03-28T11:58:13.012 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com
2022-03-28T11:58:13.067 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163
2022-03-28T11:58:13.389 INFO:teuthology.provision.fog.smithi163:Deploy complete!
2022-03-28T11:58:13.566 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2022-03-28T11:58:13.567 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-28T11:58:13.586 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com
2022-03-28T11:58:13.587 INFO:teuthology.lock.ops:New key found. Updating...
2022-03-28T11:58:13.606 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2022-03-28T11:58:13.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2022-03-28T11:58:13.841 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2022-03-28T11:58:13.896 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux"
2022-03-28T11:58:13.896 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.4 (Ootpa)"
2022-03-28T11:58:13.897 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel"
2022-03-28T11:58:13.897 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora"
2022-03-28T11:58:13.897 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.4"
2022-03-28T11:58:13.897 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2022-03-28T11:58:13.898 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-28T11:58:13.898 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2022-03-28T11:58:13.898 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-28T11:58:13.898 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/"
2022-03-28T11:58:13.899 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-28T11:58:13.899 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-28T11:58:13.899 INFO:teuthology.orchestra.run.smithi155.stdout:
2022-03-28T11:58:13.899 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-28T11:58:13.900 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-28T11:58:13.900 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-28T11:58:13.900 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-28T11:58:13.903 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2022-03-28T11:58:13.921 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server
2022-03-28T11:58:13.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com'
2022-03-28T11:58:14.142 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64
2022-03-28T11:58:14.195 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Red Hat Enterprise Linux"
2022-03-28T11:58:14.196 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8.4 (Ootpa)"
2022-03-28T11:58:14.196 INFO:teuthology.orchestra.run.smithi163.stdout:ID="rhel"
2022-03-28T11:58:14.196 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="fedora"
2022-03-28T11:58:14.196 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8.4"
2022-03-28T11:58:14.197 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8"
2022-03-28T11:58:14.197 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-03-28T11:58:14.197 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31"
2022-03-28T11:58:14.197 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-03-28T11:58:14.198 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.redhat.com/"
2022-03-28T11:58:14.198 INFO:teuthology.orchestra.run.smithi163.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-03-28T11:58:14.198 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-03-28T11:58:14.198 INFO:teuthology.orchestra.run.smithi163.stdout:
2022-03-28T11:58:14.198 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-03-28T11:58:14.199 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-03-28T11:58:14.199 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-03-28T11:58:14.199 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-03-28T11:58:14.200 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server
2022-03-28T11:58:14.297 INFO:teuthology.dispatcher.supervisor:Running job 6765314
2022-03-28T11:58:14.298 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-28_06:53:54-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi/6765314 --name vshankar-2022-03-28_06:53:54-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/no races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2022-03-28_06:53:54-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi/6765314/orig.config.yaml
2022-03-28T11:58:14.301 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-28_06:53:54-fs-wip-vshankar-fscrypt-20220324-121321-testing-default-smithi/6765314
2022-03-28T11:58:14.302 INFO:teuthology.dispatcher.supervisor:Job PID: 25074
2022-03-28T11:58:14.302 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-03-28T16:24:21.779 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-03-28T16:24:21.958 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2022-03-28T16:24:21.959 INFO:teuthology.nuke:Checking targets against current locks
2022-03-28T16:24:22.103 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-28T16:24:22.107 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-03-28T16:24:22.134 ERROR:teuthology.nuke:Could not nuke {'smithi155.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrFgVcOFmFM25rRMXv2mQzBaYyxbtNt2VsxWqmTu1t6rwLK+Oy4lgs0ga7gJdixeqTw9RZcZ9tC5u0jgTPB7E2j7At55IJU62TG8Xa+YtiUlfC4TtIDN+8+5aminn3snBagm8kTIAAPiTclMwYYLx4F0YI9RWmyYbcyp8AtefGpebkFvdHtnElbXOIDvRBDp4/SwggWtpGQuxcD2GHuBhsZ4RJYZ1WUUXSzgjhC6UURII9qjhiZiRsPQDo+xk1Cet6v3cWA4jj+E7TKXVc1ZDD/8/CppoU5GwW9/OlE2WiANFcZcOpR+QbjMkhwI9Zikk9K9I+UbWo2vX2f6099frKrZbvac68lnnfkr2x2lKi2PQnRTDehR/AskTHBEXDj0dAM2anTZbYrjPdd1mKQA0om5X3uwR3jisCmIG6gaxuQk5RR9UA8LPwoen974XfT3bNManFnvwJm+LSYBP5C8l2hNs0T/7dZ/TG/3+0Aul+xx5oBexZXHJ9NjdQ2SVekWM='}
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/nuke/__init__.py", line 297, in nuke_one
    nuke_helper(ctx, should_unlock, keep_logs, should_reboot)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/nuke/__init__.py", line 320, in nuke_helper
    check_lock.check_lock(ctx, None, check_up=False)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_70390753284281fb41f7552547fa9eb007fa4eef/teuthology/task/internal/check_lock.py", line 29, in check_lock
    'machine {name} is not locked'.format(name=machine)
AssertionError: machine smithi155.front.sepia.ceph.com is not locked
2022-03-28T16:24:22.189 INFO:teuthology.orchestra.console:Power off smithi163
2022-03-28T16:24:22.329 INFO:teuthology.orchestra.console:Power off for smithi163 completed
2022-03-28T16:24:22.474 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com
2022-03-28T16:24:22.476 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrFgVcOFmFM25rRMXv2mQzBaYyxbtNt2VsxWqmTu1t6rwLK+Oy4lgs0ga7gJdixeqTw9RZcZ9tC5u0jgTPB7E2j7At55IJU62TG8Xa+YtiUlfC4TtIDN+8+5aminn3snBagm8kTIAAPiTclMwYYLx4F0YI9RWmyYbcyp8AtefGpebkFvdHtnElbXOIDvRBDp4/SwggWtpGQuxcD2GHuBhsZ4RJYZ1WUUXSzgjhC6UURII9qjhiZiRsPQDo+xk1Cet6v3cWA4jj+E7TKXVc1ZDD/8/CppoU5GwW9/OlE2WiANFcZcOpR+QbjMkhwI9Zikk9K9I+UbWo2vX2f6099frKrZbvac68lnnfkr2x2lKi2PQnRTDehR/AskTHBEXDj0dAM2anTZbYrjPdd1mKQA0om5X3uwR3jisCmIG6gaxuQk5RR9UA8LPwoen974XfT3bNManFnvwJm+LSYBP5C8l2hNs0T/7dZ/TG/3+0Aul+xx5oBexZXHJ9NjdQ2SVekWM=