2022-02-19T15:16:34.367 INFO:root:teuthology version: 1.1.0-eea25212
2022-02-19T15:16:34.490 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi104.front.sepia.ceph.com' reimaging
2022-02-19T15:16:34.492 INFO:teuthology.lock.ops:Updating [ubuntu@smithi104.front.sepia.ceph.com]: reset os type and version on server
2022-02-19T15:16:34.492 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2022-02-19T15:16:34.511 INFO:teuthology.lock.ops:Node 'ubuntu@smithi104.front.sepia.ceph.com' reimaging is complete
2022-02-19T15:16:34.512 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging
2022-02-19T15:16:34.512 INFO:teuthology.lock.ops:Updating [ubuntu@smithi119.front.sepia.ceph.com]: reset os type and version on server
2022-02-19T15:16:34.512 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2022-02-19T15:16:34.534 INFO:teuthology.lock.ops:Node 'ubuntu@smithi119.front.sepia.ceph.com' reimaging is complete
2022-02-19T15:16:34.733 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.4
2022-02-19T15:16:34.741 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.4
2022-02-19T15:16:35.067 ERROR:teuthology.provision.fog.smithi119:500: { "error": "Host is already a member of an active task"
}
2022-02-19T15:16:35.069 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/dispatcher/supervisor.py", line 206, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/lock/ops.py", line 315, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/fog.py", line 79, in create
    task_id = self.schedule_deploy_task(host_id)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/fog.py", line 199, in schedule_deploy_task
    data='{"taskTypeID": %i}' % deploy_id,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/fog.py", line 123, in do_request
    resp.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/virtualenv/lib/python3.6/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/236/task
2022-02-19T15:16:35.131 INFO:teuthology.nuke:Checking targets against current locks
2022-02-19T15:16:35.256 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-19T15:16:35.260 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-19T15:16:35.281 ERROR:teuthology.nuke:Could not nuke {'ubuntu@smithi119.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL3MTava695xB+sR9i/l46unw6rmOQg1gc1CwZ1izsHez2zUgX70jnDVpP0oppnIUy6VYDqDyvmtOL5T6noOxInyGKvijAe5zuNigO4rj6CGgn913/PKYw8XLy50KLY1ZsUK2TkqKmL27ydIK8CRqiIX0SV3solJ8x6Dxef3KyGE0avAC+01J9+dL1ptecXnCapYqig6OQs0V48hkPB+or5JQaZNTZF6PKe5gsm4AKjOqe95gluH7cuKzpiw9dPnHno1BkY+EtfS1mfIFj9jn59Zx4/NAVVncIDgZvu830GMAVcXXlQ5Yjcty2CeYGwp3ZUY2gzZS7loc/QeBvxS7G2FA0ss3pJ+VkBXwuybk+tiws/akq2Gh5E77B60NAUYZLzkS32mzm+GY6RrvDhFyDKyg7VV65dQ/Qz+aBE5lAZTOUWIwjn1ZB825wTUlhVspTnLPZsfzQPaiWxH4aurmc/mtF+pzXDc1TDuym3Vq4o/SzXFmt2bOkq//TvGcTkgU='}
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/nuke/__init__.py", line 292, in nuke_one
    nuke_helper(ctx, should_unlock, keep_logs, should_reboot)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/nuke/__init__.py", line 315, in nuke_helper
    check_lock.check_lock(ctx, None, check_up=False)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/task/internal/check_lock.py", line 29, in check_lock
    'machine {name} is not locked'.format(name=machine)
AssertionError: machine ubuntu@smithi119.front.sepia.ceph.com is not locked
2022-02-19T15:16:35.332 INFO:teuthology.orchestra.console:Power off smithi104
2022-02-19T15:16:35.374 INFO:teuthology.orchestra.console:Power off smithi104
2022-02-19T15:16:47.824 INFO:teuthology.orchestra.console:Power off for smithi104 completed
2022-02-19T15:16:47.844 INFO:teuthology.orchestra.console:Power off for smithi104 completed
2022-02-19T15:16:47.945 INFO:teuthology.orchestra.console:Power on smithi104
2022-02-19T15:16:47.975 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com
2022-02-19T15:16:47.977 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  ubuntu@smithi119.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL3MTava695xB+sR9i/l46unw6rmOQg1gc1CwZ1izsHez2zUgX70jnDVpP0oppnIUy6VYDqDyvmtOL5T6noOxInyGKvijAe5zuNigO4rj6CGgn913/PKYw8XLy50KLY1ZsUK2TkqKmL27ydIK8CRqiIX0SV3solJ8x6Dxef3KyGE0avAC+01J9+dL1ptecXnCapYqig6OQs0V48hkPB+or5JQaZNTZF6PKe5gsm4AKjOqe95gluH7cuKzpiw9dPnHno1BkY+EtfS1mfIFj9jn59Zx4/NAVVncIDgZvu830GMAVcXXlQ5Yjcty2CeYGwp3ZUY2gzZS7loc/QeBvxS7G2FA0ss3pJ+VkBXwuybk+tiws/akq2Gh5E77B60NAUYZLzkS32mzm+GY6RrvDhFyDKyg7VV65dQ/Qz+aBE5lAZTOUWIwjn1ZB825wTUlhVspTnLPZsfzQPaiWxH4aurmc/mtF+pzXDc1TDuym3Vq4o/SzXFmt2bOkq//TvGcTkgU=
2022-02-19T15:16:48.176 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/virtualenv/bin/teuthology-dispatcher", line 33, in <module>
    sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')())
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/scripts/dispatcher.py", line 33, in main
    teuthology.dispatcher.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/dispatcher/__init__.py", line 61, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/dispatcher/supervisor.py", line 52, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/dispatcher/supervisor.py", line 206, in reimage
    reimaged = reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/lock/ops.py", line 315, in reimage_machines
    log.info("Node '%s' reimaging is complete", machine)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/__init__.py", line 39, in reimage
    return obj.create()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/fog.py", line 79, in create
    task_id = self.schedule_deploy_task(host_id)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/fog.py", line 199, in schedule_deploy_task
    data='{"taskTypeID": %i}' % deploy_id,
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/teuthology/provision/fog.py", line 123, in do_request
    resp.raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/virtualenv/lib/python3.6/site-packages/requests/models.py", line 953, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/236/task