2023-04-04T04:01:17.829 INFO:root:teuthology version: 0.0.1.dev93+gd7c4062 2023-04-04T04:01:17.979 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-04-04T04:01:17.980 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-04-04T04:01:17.981 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-04-04T04:01:18.039 INFO:teuthology.lock.ops:Node 'smithi117.front.sepia.ceph.com' reimaging is complete 2023-04-04T04:01:18.040 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-04-04T04:01:18.040 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-04-04T04:01:18.040 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-04-04T04:01:18.063 INFO:teuthology.lock.ops:Node 'smithi129.front.sepia.ceph.com' reimaging is complete 2023-04-04T04:01:18.206 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of ubuntu 22.04 2023-04-04T04:01:18.209 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 22.04 2023-04-04T04:01:18.635 INFO:teuthology.orchestra.console:Power off smithi129 2023-04-04T04:01:18.649 INFO:teuthology.orchestra.console:Power off smithi117 2023-04-04T04:01:18.778 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2023-04-04T04:01:18.879 INFO:teuthology.orchestra.console:Power on smithi129 2023-04-04T04:01:27.018 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-04-04T04:01:27.120 INFO:teuthology.orchestra.console:Power on smithi117 2023-04-04T04:01:27.241 INFO:teuthology.orchestra.console:Power on for smithi129 completed 2023-04-04T04:01:27.342 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-04-04T04:01:35.487 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2023-04-04T04:01:35.588 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-04-04T04:06:23.420 WARNING:teuthology.provision.fog:timed out 2023-04-04T04:06:47.813 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-04-04T04:06:56.873 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-04-04T04:07:02.877 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-04-04T04:07:08.882 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-04-04T04:07:14.890 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-04-04T04:07:20.894 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-04-04T04:07:27.151 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-04T04:07:27.633 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-04-04T04:07:27.680 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2023-04-04T04:07:27.728 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-04-04T04:07:28.031 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-04-04T04:09:20.197 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-04-04T04:09:29.253 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-04-04T04:09:38.309 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-04-04T04:09:47.365 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-04-04T04:09:56.425 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-04-04T04:10:05.509 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-04-04T04:11:11.574 WARNING:teuthology.provision.fog:timed out 2023-04-04T04:11:17.787 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-04T04:11:18.215 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-04-04T04:11:18.261 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-04-04T04:11:18.309 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-04-04T04:11:18.612 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-04-04T04:11:27.761 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/lock/ops.py", line 288, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/misc.py", line 1106, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi117.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2023-04-04T04:11:27.850 INFO:teuthology.nuke:Checking targets against current locks 2023-04-04T04:11:27.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-04T04:11:27.926 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-04T04:11:27.985 INFO:teuthology.orchestra.console:Power off smithi117 2023-04-04T04:11:28.023 INFO:teuthology.orchestra.console:Power off smithi129 2023-04-04T04:11:36.364 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-04-04T04:11:36.519 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com 2023-04-04T04:11:40.507 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2023-04-04T04:11:40.666 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2023-04-04T04:11:40.900 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/dispatcher/supervisor.py", line 56, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/lock/ops.py", line 325, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/lock/ops.py", line 288, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/misc.py", line 1106, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_d7c4062c8e48ef4dca373feb7285bdfb014e59b7/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi117.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds