2023-06-15T04:57:57.753 INFO:root:teuthology version: 0.0.1.dev122+gb580191
2023-06-15T04:57:57.953 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging
2023-06-15T04:57:57.955 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server
2023-06-15T04:57:57.955 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server
2023-06-15T04:57:57.985 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2023-06-15T04:57:57.986 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2023-06-15T04:57:57.986 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-06-15T04:57:58.008 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging
2023-06-15T04:57:58.009 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server
2023-06-15T04:57:58.009 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server
2023-06-15T04:57:58.154 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of rhel 8.6
2023-06-15T04:57:58.184 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6
2023-06-15T04:57:58.187 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6
2023-06-15T04:57:58.449 INFO:teuthology.orchestra.console:Power off smithi005
2023-06-15T04:57:58.467 INFO:teuthology.orchestra.console:Power off smithi033
2023-06-15T04:57:58.485 INFO:teuthology.orchestra.console:Power off smithi190
2023-06-15T04:57:58.628 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2023-06-15T04:57:58.642 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2023-06-15T04:57:58.730 INFO:teuthology.orchestra.console:Power on smithi033
2023-06-15T04:57:58.744 INFO:teuthology.orchestra.console:Power on smithi190
2023-06-15T04:58:07.105 INFO:teuthology.orchestra.console:Power on for smithi033 completed
2023-06-15T04:58:07.112 INFO:teuthology.orchestra.console:Power on for smithi190 completed
2023-06-15T04:58:07.207 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2023-06-15T04:58:07.213 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish
2023-06-15T04:58:10.971 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2023-06-15T04:58:11.072 INFO:teuthology.orchestra.console:Power on smithi005
2023-06-15T04:58:19.447 INFO:teuthology.orchestra.console:Power on for smithi005 completed
2023-06-15T04:58:19.548 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish
2023-06-15T05:00:22.792 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-06-15T05:00:22.794 ERROR:paramiko.transport:Traceback (most recent call last):
2023-06-15T05:00:22.794 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-06-15T05:00:22.794 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-06-15T05:00:22.794 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-06-15T05:00:22.795 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-06-15T05:00:22.795 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
2023-06-15T05:00:22.795 ERROR:paramiko.transport:    raise EOFError()
2023-06-15T05:00:22.795 ERROR:paramiko.transport:EOFError
2023-06-15T05:00:22.795 ERROR:paramiko.transport:
2023-06-15T05:00:22.796 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-06-15T05:00:22.796 ERROR:paramiko.transport:
2023-06-15T05:00:22.796 ERROR:paramiko.transport:Traceback (most recent call last):
2023-06-15T05:00:22.796 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-06-15T05:00:22.796 ERROR:paramiko.transport:    self._check_banner()
2023-06-15T05:00:22.797 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-06-15T05:00:22.797 ERROR:paramiko.transport:    raise SSHException(
2023-06-15T05:00:22.797 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-06-15T05:00:22.797 ERROR:paramiko.transport:
2023-06-15T05:00:22.798 WARNING:teuthology.provision.fog:Error reading SSH protocol banner
2023-06-15T05:01:08.592 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-15T05:01:11.412 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-06-15T05:01:17.648 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-15T05:01:20.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-06-15T05:01:26.708 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-15T05:01:28.808 WARNING:teuthology.provision.fog:timed out
2023-06-15T05:01:29.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-06-15T05:01:35.792 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.5
2023-06-15T05:01:38.608 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.190
2023-06-15T05:01:50.392 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-15T05:01:50.803 INFO:teuthology.provision.fog.smithi033:Node is ready
2023-06-15T05:01:50.820 INFO:teuthology.orchestra.run.smithi033.stdout:smithi022
2023-06-15T05:01:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-06-15T05:01:51.395 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-06-15T05:01:51.396 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-06-15T05:01:51.396 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-06-15T05:01:51.396 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-06-15T05:01:51.396 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-06-15T05:01:51.396 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-06-15T05:01:51.397 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-15T05:01:51.398 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-15T05:01:51.398 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-15T05:01:51.398 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-15T05:01:51.399 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2023-06-15T05:02:41.848 WARNING:teuthology.provision.fog:timed out
2023-06-15T05:02:44.613 WARNING:teuthology.provision.fog:timed out
2023-06-15T05:02:48.195 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-15T05:02:48.490 INFO:teuthology.provision.fog.smithi005:Node is ready
2023-06-15T05:02:48.508 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com
2023-06-15T05:02:48.567 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005
2023-06-15T05:02:48.969 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux"
2023-06-15T05:02:48.969 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)"
2023-06-15T05:02:48.969 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel"
2023-06-15T05:02:48.969 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora"
2023-06-15T05:02:48.969 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-15T05:02:48.970 INFO:teuthology.orchestra.run.smithi005.stdout:
2023-06-15T05:02:48.971 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-15T05:02:48.971 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-15T05:02:48.971 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-15T05:02:48.971 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-15T05:02:48.971 INFO:teuthology.provision.fog.smithi005:Deploy complete!
2023-06-15T05:02:50.860 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-15T05:02:51.195 INFO:teuthology.provision.fog.smithi190:Node is ready
2023-06-15T05:02:51.212 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com
2023-06-15T05:02:51.273 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190
2023-06-15T05:02:51.677 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux"
2023-06-15T05:02:51.678 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)"
2023-06-15T05:02:51.678 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel"
2023-06-15T05:02:51.678 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora"
2023-06-15T05:02:51.678 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6"
2023-06-15T05:02:51.678 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:
2023-06-15T05:02:51.679 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-15T05:02:51.680 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-15T05:02:51.680 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-15T05:02:51.680 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-15T05:02:51.680 INFO:teuthology.provision.fog.smithi190:Deploy complete!
2023-06-15T05:03:00.854 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/supervisor.py", line 226, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/misc.py", line 1106, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi033.front.sepia.ceph.com' reached maximum tries (6) after waiting for 5 seconds
2023-06-15T05:03:00.927 INFO:teuthology.nuke:Checking targets against current locks
2023-06-15T05:03:00.981 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-15T05:03:01.001 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-15T05:03:01.027 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-15T05:03:01.060 INFO:teuthology.orchestra.console:Power off smithi005
2023-06-15T05:03:01.079 INFO:teuthology.orchestra.console:Power off smithi033
2023-06-15T05:03:01.145 INFO:teuthology.orchestra.console:Power off smithi190
2023-06-15T05:03:01.221 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2023-06-15T05:03:01.376 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2023-06-15T05:03:09.442 INFO:teuthology.orchestra.console:Power off for smithi005 completed
2023-06-15T05:03:09.600 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com
2023-06-15T05:03:13.634 INFO:teuthology.orchestra.console:Power off for smithi190 completed
2023-06-15T05:03:13.790 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com
2023-06-15T05:03:14.209 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/supervisor.py", line 56, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/supervisor.py", line 226, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/misc.py", line 1106, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi033.front.sepia.ceph.com' reached maximum tries (6) after waiting for 5 seconds