2023-06-15T10:48:58.984 INFO:root:teuthology version: 0.0.1.dev122+gb580191
2023-06-15T10:48:59.194 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2023-06-15T10:48:59.195 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2023-06-15T10:48:59.196 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-06-15T10:48:59.225 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging
2023-06-15T10:48:59.225 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server
2023-06-15T10:48:59.225 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server
2023-06-15T10:48:59.251 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging
2023-06-15T10:48:59.252 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server
2023-06-15T10:48:59.252 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server
2023-06-15T10:48:59.391 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6
2023-06-15T10:48:59.420 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of rhel 8.6
2023-06-15T10:48:59.435 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of rhel 8.6
2023-06-15T10:48:59.681 INFO:teuthology.orchestra.console:Power off smithi148
2023-06-15T10:48:59.701 INFO:teuthology.orchestra.console:Power off smithi195
2023-06-15T10:48:59.840 INFO:teuthology.orchestra.console:Power off smithi086
2023-06-15T10:48:59.853 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2023-06-15T10:48:59.854 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2023-06-15T10:48:59.955 INFO:teuthology.orchestra.console:Power on smithi148
2023-06-15T10:48:59.966 INFO:teuthology.orchestra.console:Power on smithi195
2023-06-15T10:48:59.997 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-06-15T10:49:00.099 INFO:teuthology.orchestra.console:Power on smithi086
2023-06-15T10:49:08.335 INFO:teuthology.orchestra.console:Power on for smithi148 completed
2023-06-15T10:49:08.437 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish
2023-06-15T10:49:08.448 INFO:teuthology.orchestra.console:Power on for smithi195 completed
2023-06-15T10:49:08.548 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish
2023-06-15T10:49:08.554 INFO:teuthology.orchestra.console:Power on for smithi086 completed
2023-06-15T10:49:08.655 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2023-06-15T10:52:39.865 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-06-15T10:52:39.867 ERROR:paramiko.transport:Traceback (most recent call last):
2023-06-15T10:52:39.867 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-06-15T10:52:39.868 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-06-15T10:52:39.868 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-06-15T10:52:39.868 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-06-15T10:52:39.868 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
2023-06-15T10:52:39.868 ERROR:paramiko.transport:    raise EOFError()
2023-06-15T10:52:39.869 ERROR:paramiko.transport:EOFError
2023-06-15T10:52:39.869 ERROR:paramiko.transport:
2023-06-15T10:52:39.869 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-06-15T10:52:39.869 ERROR:paramiko.transport:
2023-06-15T10:52:39.869 ERROR:paramiko.transport:Traceback (most recent call last):
2023-06-15T10:52:39.870 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-06-15T10:52:39.870 ERROR:paramiko.transport:    self._check_banner()
2023-06-15T10:52:39.870 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-06-15T10:52:39.870 ERROR:paramiko.transport:    raise SSHException(
2023-06-15T10:52:39.870 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-06-15T10:52:39.871 ERROR:paramiko.transport:
2023-06-15T10:52:39.871 WARNING:teuthology.provision.fog:Error reading SSH protocol banner
2023-06-15T10:52:58.356 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-06-15T10:52:58.357 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-06-15T10:53:07.440 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-06-15T10:53:07.441 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-06-15T10:53:16.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-06-15T10:53:16.497 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-06-15T10:53:25.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-06-15T10:53:25.553 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-06-15T10:53:34.612 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.148
2023-06-15T10:53:45.883 WARNING:teuthology.provision.fog:timed out
2023-06-15T10:53:50.064 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-06-15T10:53:59.120 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.195
2023-06-15T10:54:02.100 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-06-15T10:54:08.461 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-15T10:54:08.741 INFO:teuthology.provision.fog.smithi195:Node is ready
2023-06-15T10:54:08.758 INFO:teuthology.orchestra.run.smithi195.stdout:smithi022
2023-06-15T10:54:08.821 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-06-15T10:54:09.221 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux"
2023-06-15T10:54:09.221 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)"
2023-06-15T10:54:09.221 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-15T10:54:09.222 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/"
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-15T10:54:09.223 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-15T10:54:09.224 INFO:teuthology.provision.fog.smithi195:Deploy complete!
2023-06-15T10:54:11.188 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-06-15T10:54:17.328 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-06-15T10:54:23.397 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-15T10:54:23.464 INFO:teuthology.provision.fog.smithi086:Node is ready
2023-06-15T10:54:23.519 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086
2023-06-15T10:54:23.574 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086 smithi086
2023-06-15T10:54:23.962 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux"
2023-06-15T10:54:23.963 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)"
2023-06-15T10:54:23.963 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel"
2023-06-15T10:54:23.963 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora"
2023-06-15T10:54:23.963 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6"
2023-06-15T10:54:23.963 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-15T10:54:23.964 INFO:teuthology.orchestra.run.smithi086.stdout:
2023-06-15T10:54:23.965 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-15T10:54:23.965 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-15T10:54:23.965 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-15T10:54:23.965 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-15T10:54:23.965 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2023-06-15T10:54:40.632 WARNING:teuthology.provision.fog:timed out
2023-06-15T10:54:46.865 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-15T10:54:47.218 INFO:teuthology.provision.fog.smithi148:Node is ready
2023-06-15T10:54:47.236 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com
2023-06-15T10:54:47.296 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148
2023-06-15T10:54:47.707 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Red Hat Enterprise Linux"
2023-06-15T10:54:47.707 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="8.6 (Ootpa)"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:ID="rhel"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE="fedora"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="8.6"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:PLATFORM_ID="platform:el8"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:ANSI_COLOR="0;31"
2023-06-15T10:54:47.708 INFO:teuthology.orchestra.run.smithi148.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.redhat.com/"
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-15T10:54:47.709 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-15T10:54:47.710 INFO:teuthology.orchestra.run.smithi148.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-15T10:54:47.710 INFO:teuthology.provision.fog.smithi148:Deploy complete!
2023-06-15T10:54:56.843 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/supervisor.py", line 226, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/misc.py", line 1106, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi086.front.sepia.ceph.com' reached maximum tries (6) after waiting for 5 seconds
2023-06-15T10:54:56.925 INFO:teuthology.nuke:Checking targets against current locks
2023-06-15T10:54:56.980 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-15T10:54:57.015 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-15T10:54:57.040 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-15T10:54:57.074 INFO:teuthology.orchestra.console:Power off smithi086
2023-06-15T10:54:57.115 INFO:teuthology.orchestra.console:Power off smithi148
2023-06-15T10:54:57.159 INFO:teuthology.orchestra.console:Power off smithi195
2023-06-15T10:55:05.528 INFO:teuthology.orchestra.console:Power off for smithi195 completed
2023-06-15T10:55:05.682 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com
2023-06-15T10:55:09.574 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-06-15T10:55:09.605 INFO:teuthology.orchestra.console:Power off for smithi148 completed
2023-06-15T10:55:09.738 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com
2023-06-15T10:55:09.753 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com
2023-06-15T10:55:10.160 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/supervisor.py", line 56, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/dispatcher/supervisor.py", line 226, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 326, in reimage_machines
    reimaged = do_update_keys(list(reimaged.keys()))[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/lock/ops.py", line 290, in do_update_keys
    keys_dict = misc.ssh_keyscan(machines, _raise=_raise)
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/misc.py", line 1106, in ssh_keyscan
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_b580191f840dede6fc19423f098cbe32f5ed42bf/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi086.front.sepia.ceph.com' reached maximum tries (6) after waiting for 5 seconds