2023-04-15T11:59:55.499 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-15T11:59:55.692 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging 2023-04-15T11:59:55.693 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server 2023-04-15T11:59:55.694 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-04-15T11:59:55.723 INFO:teuthology.lock.ops:Node 'smithi066.front.sepia.ceph.com' reimaging is complete 2023-04-15T11:59:55.724 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2023-04-15T11:59:55.724 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2023-04-15T11:59:55.724 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2023-04-15T11:59:55.748 INFO:teuthology.lock.ops:Node 'smithi115.front.sepia.ceph.com' reimaging is complete 2023-04-15T11:59:55.748 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-04-15T11:59:55.748 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-04-15T11:59:55.749 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-04-15T11:59:55.772 INFO:teuthology.lock.ops:Node 'smithi174.front.sepia.ceph.com' reimaging is complete 2023-04-15T11:59:55.900 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of ubuntu 22.04 2023-04-15T11:59:55.902 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of ubuntu 22.04 2023-04-15T11:59:55.950 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of ubuntu 22.04 2023-04-15T11:59:56.245 INFO:teuthology.orchestra.console:Power off smithi115 2023-04-15T11:59:56.295 INFO:teuthology.orchestra.console:Power off smithi066 2023-04-15T11:59:56.366 INFO:teuthology.orchestra.console:Power off smithi174 2023-04-15T12:00:08.743 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-04-15T12:00:08.773 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2023-04-15T12:00:08.840 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2023-04-15T12:00:08.845 INFO:teuthology.orchestra.console:Power on smithi115 2023-04-15T12:00:08.874 INFO:teuthology.orchestra.console:Power on smithi066 2023-04-15T12:00:08.941 INFO:teuthology.orchestra.console:Power on smithi174 2023-04-15T12:00:13.098 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2023-04-15T12:00:13.200 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2023-04-15T12:00:17.244 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2023-04-15T12:00:17.306 INFO:teuthology.orchestra.console:Power on for smithi174 completed 2023-04-15T12:00:17.345 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2023-04-15T12:00:17.407 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-04-15T12:03:18.506 ERROR:teuthology.orchestra.connection:Error authenticating with smithi174.front.sepia.ceph.com: Authentication failed. 2023-04-15T12:03:47.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-04-15T12:03:56.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-04-15T12:04:05.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-04-15T12:04:15.013 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-04-15T12:04:19.510 WARNING:teuthology.provision.fog:timed out 2023-04-15T12:04:24.069 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-04-15T12:04:33.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.115 2023-04-15T12:04:43.909 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-04-15T12:04:52.965 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-04-15T12:04:58.967 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-04-15T12:05:04.969 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-04-15T12:05:10.972 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-04-15T12:05:16.975 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-04-15T12:05:18.677 WARNING:teuthology.provision.fog:timed out 2023-04-15T12:05:23.115 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-15T12:05:23.593 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-04-15T12:05:23.637 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-04-15T12:05:23.686 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-04-15T12:05:24.045 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-04-15T12:05:27.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-04-15T12:05:36.805 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-04-15T12:05:39.127 WARNING:teuthology.provision.fog:timed out 2023-04-15T12:05:45.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-15T12:05:45.811 INFO:teuthology.provision.fog.smithi115:Node is ready 2023-04-15T12:05:45.860 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2023-04-15T12:05:45.861 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-04-15T12:05:45.908 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2023-04-15T12:05:46.218 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2023-04-15T12:05:54.917 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-04-15T12:06:03.973 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-04-15T12:07:09.976 WARNING:teuthology.provision.fog:timed out 2023-04-15T12:07:16.194 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-15T12:07:16.681 INFO:teuthology.provision.fog.smithi066:Node is ready 2023-04-15T12:07:16.728 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2023-04-15T12:07:16.777 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2023-04-15T12:07:17.101 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2023-04-15T12:07:26.365 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/lock/ops.py", line 325, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/lock/ops.py", line 288, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/misc.py", line 1106, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi174.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2023-04-15T12:07:26.442 INFO:teuthology.nuke:Checking targets against current locks 2023-04-15T12:07:26.498 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-15T12:07:26.531 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-15T12:07:26.555 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-04-15T12:07:26.585 INFO:teuthology.orchestra.console:Power off smithi066 2023-04-15T12:07:26.636 INFO:teuthology.orchestra.console:Power off smithi115 2023-04-15T12:07:26.660 INFO:teuthology.orchestra.console:Power off smithi174 2023-04-15T12:07:35.017 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2023-04-15T12:07:35.033 INFO:teuthology.orchestra.console:Power off for smithi174 completed 2023-04-15T12:07:35.172 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2023-04-15T12:07:35.187 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com 2023-04-15T12:07:39.080 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2023-04-15T12:07:39.230 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com 2023-04-15T12:07:39.569 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 56, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/lock/ops.py", line 325, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/lock/ops.py", line 288, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/misc.py", line 1106, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi174.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds