2021-11-19T16:11:45.414 INFO:root:teuthology version: 1.1.0-6cfddd5e
2021-11-19T16:11:45.537 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging
2021-11-19T16:11:45.538 INFO:teuthology.lock.ops:Updating [ubuntu@smithi082.front.sepia.ceph.com]: reset os type and version on server
2021-11-19T16:11:45.540 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2021-11-19T16:11:45.560 INFO:teuthology.lock.ops:Node 'ubuntu@smithi082.front.sepia.ceph.com' reimaging is complete
2021-11-19T16:11:45.560 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging
2021-11-19T16:11:45.561 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server
2021-11-19T16:11:45.561 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2021-11-19T16:11:45.582 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete
2021-11-19T16:11:45.765 INFO:teuthology.provision.fog.smithi082:Scheduling deploy of rhel 8.4
2021-11-19T16:11:45.794 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.4
2021-11-19T16:11:46.092 INFO:teuthology.orchestra.console:Power off smithi082
2021-11-19T16:11:46.133 INFO:teuthology.orchestra.console:Power off smithi190
2021-11-19T16:11:46.245 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2021-11-19T16:11:46.277 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2021-11-19T16:11:46.347 INFO:teuthology.orchestra.console:Power on smithi082
2021-11-19T16:11:46.379 INFO:teuthology.orchestra.console:Power on smithi190
2021-11-19T16:11:54.718 INFO:teuthology.orchestra.console:Power on for smithi082 completed
2021-11-19T16:11:54.740 INFO:teuthology.orchestra.console:Power on for smithi190 completed
2021-11-19T16:11:54.819 INFO:teuthology.provision.fog.smithi082:Waiting for deploy to finish
2021-11-19T16:11:54.842 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2021-11-19T16:16:06.849 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-19T16:16:21.930 INFO:teuthology.provision.fog.smithi190:Node is ready
2021-11-19T16:16:21.950 INFO:teuthology.orchestra.run.smithi190.stdout:smithi204
2021-11-19T16:16:22.007 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2021-11-19T16:16:22.363 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2021-11-19T16:16:44.374 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-11-19T16:16:44.614 INFO:teuthology.provision.fog.smithi082:Node is ready
2021-11-19T16:16:44.629 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082.front.sepia.ceph.com
2021-11-19T16:16:44.684 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82 smithi082.front.sepia.ceph.com smithi082
2021-11-19T16:16:45.020 INFO:teuthology.provision.fog.smithi082:Deploy complete!
2021-11-19T16:16:45.183 INFO:teuthology.lock.ops:Checking smithi082.front.sepia.ceph.com
2021-11-19T16:16:45.185 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-19T16:16:45.206 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com
2021-11-19T16:16:45.207 INFO:teuthology.lock.ops:New key found. Updating...
2021-11-19T16:16:45.226 INFO:teuthology.lock.ops:Updating [smithi082.front.sepia.ceph.com]: set os type and version on server
2021-11-19T16:16:45.226 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com'
2021-11-19T16:16:45.414 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64
2021-11-19T16:16:45.468 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux"
2021-11-19T16:16:45.468 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.4 (Ootpa)"
2021-11-19T16:16:45.469 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel"
2021-11-19T16:16:45.469 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora"
2021-11-19T16:16:45.469 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.4"
2021-11-19T16:16:45.469 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8"
2021-11-19T16:16:45.470 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-19T16:16:45.470 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31"
2021-11-19T16:16:45.470 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-19T16:16:45.470 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/"
2021-11-19T16:16:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-19T16:16:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-19T16:16:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:
2021-11-19T16:16:45.471 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-19T16:16:45.472 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-19T16:16:45.472 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-19T16:16:45.472 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-19T16:16:45.473 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server
2021-11-19T16:16:45.521 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server
2021-11-19T16:16:45.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com'
2021-11-19T16:16:45.756 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64
2021-11-19T16:16:45.811 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux"
2021-11-19T16:16:45.812 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.4 (Ootpa)"
2021-11-19T16:16:45.812 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel"
2021-11-19T16:16:45.812 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora"
2021-11-19T16:16:45.812 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.4"
2021-11-19T16:16:45.813 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8"
2021-11-19T16:16:45.813 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2021-11-19T16:16:45.813 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2021-11-19T16:16:45.814 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2021-11-19T16:16:45.814 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/"
2021-11-19T16:16:45.814 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2021-11-19T16:16:45.815 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-11-19T16:16:45.815 INFO:teuthology.orchestra.run.smithi190.stdout:
2021-11-19T16:16:45.815 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2021-11-19T16:16:45.816 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2021-11-19T16:16:45.816 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2021-11-19T16:16:45.816 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2021-11-19T16:16:45.817 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2021-11-19T16:16:45.913 INFO:teuthology.dispatcher.supervisor:Running job 6513945
2021-11-19T16:16:45.913 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-19_15:58:40-rbd-wip-yuri5-testing-2021-11-19-0638-pacific-distro-basic-smithi/6513945 --name yuriw-2021-11-19_15:58:40-rbd-wip-yuri5-testing-2021-11-19-0638-pacific-distro-basic-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-workunit} -- /home/teuthworker/archive/yuriw-2021-11-19_15:58:40-rbd-wip-yuri5-testing-2021-11-19-0638-pacific-distro-basic-smithi/6513945/orig.config.yaml
2021-11-19T16:16:45.917 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-19_15:58:40-rbd-wip-yuri5-testing-2021-11-19-0638-pacific-distro-basic-smithi/6513945
2021-11-19T16:16:45.918 INFO:teuthology.dispatcher.supervisor:Job PID: 28184
2021-11-19T16:16:45.918 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-11-19T16:40:46.571 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-11-19T16:40:46.745 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2021-11-19T16:40:46.746 INFO:teuthology.nuke:Checking targets against current locks
2021-11-19T16:40:46.874 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-19T16:40:46.878 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-11-19T16:40:46.953 INFO:teuthology.orchestra.console:Power off smithi190
2021-11-19T16:40:46.979 INFO:teuthology.orchestra.console:Power off smithi082
2021-11-19T16:40:59.462 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2021-11-19T16:40:59.469 INFO:teuthology.orchestra.console:Power off for smithi082 completed
2021-11-19T16:41:26.774 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/dispatcher/supervisor.py", line 59, in main
    verbose
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/dispatcher/supervisor.py", line 152, in run_job
    unlock_targets(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/dispatcher/supervisor.py", line 207, in unlock_targets
    nuke(fake_ctx, True)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/nuke/__init__.py", line 268, in nuke
    for unnuked in p:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/nuke/__init__.py", line 299, in nuke_one
    unlock_one(ctx, list(target.keys())[0], ctx.owner)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/lock/ops.py", line 204, in unlock_one
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'unlock smithi190.front.sepia.ceph.com' reached maximum tries (10) after waiting for 32.5 seconds