2022-01-27T20:38:14.602 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-27T20:38:14.767 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging 2022-01-27T20:38:14.768 INFO:teuthology.lock.ops:Updating [ubuntu@smithi018.front.sepia.ceph.com]: reset os type and version on server 2022-01-27T20:38:14.768 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2022-01-27T20:38:14.787 INFO:teuthology.lock.ops:Node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging is complete 2022-01-27T20:38:14.788 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging 2022-01-27T20:38:14.788 INFO:teuthology.lock.ops:Updating [ubuntu@smithi087.front.sepia.ceph.com]: reset os type and version on server 2022-01-27T20:38:14.788 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2022-01-27T20:38:14.810 INFO:teuthology.lock.ops:Node 'ubuntu@smithi087.front.sepia.ceph.com' reimaging is complete 2022-01-27T20:38:14.810 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging 2022-01-27T20:38:14.810 INFO:teuthology.lock.ops:Updating [ubuntu@smithi110.front.sepia.ceph.com]: reset os type and version on server 2022-01-27T20:38:14.811 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2022-01-27T20:38:14.831 INFO:teuthology.lock.ops:Node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging is complete 2022-01-27T20:38:15.003 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of rhel 8.4 2022-01-27T20:38:15.049 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.4 2022-01-27T20:38:15.064 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of rhel 8.4 2022-01-27T20:38:15.345 INFO:teuthology.orchestra.console:Power off smithi018 2022-01-27T20:38:15.404 INFO:teuthology.orchestra.console:Power off smithi110 2022-01-27T20:38:15.474 INFO:teuthology.orchestra.console:Power off smithi087 2022-01-27T20:38:15.517 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-01-27T20:38:15.550 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2022-01-27T20:38:15.619 INFO:teuthology.orchestra.console:Power on smithi018 2022-01-27T20:38:15.631 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2022-01-27T20:38:15.659 INFO:teuthology.orchestra.console:Power on smithi110 2022-01-27T20:38:15.734 INFO:teuthology.orchestra.console:Power on smithi087 2022-01-27T20:38:24.006 INFO:teuthology.orchestra.console:Power on for smithi018 completed 2022-01-27T20:38:24.049 INFO:teuthology.orchestra.console:Power on for smithi110 completed 2022-01-27T20:38:24.104 INFO:teuthology.orchestra.console:Power on for smithi087 completed 2022-01-27T20:38:24.107 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2022-01-27T20:38:24.150 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2022-01-27T20:38:24.206 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2022-01-27T20:42:24.144 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-27T20:42:37.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-27T20:42:37.869 INFO:teuthology.provision.fog.smithi018:Node is ready 2022-01-27T20:42:37.886 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2022-01-27T20:42:37.950 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2022-01-27T20:42:38.319 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2022-01-27T20:42:43.842 INFO:teuthology.provision.fog.smithi087:Node is ready 2022-01-27T20:42:43.860 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 2022-01-27T20:42:43.924 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087 smithi087 2022-01-27T20:42:44.272 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2022-01-27T20:43:04.899 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-27T20:43:05.115 INFO:teuthology.provision.fog.smithi110:Node is ready 2022-01-27T20:43:05.130 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2022-01-27T20:43:05.191 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2022-01-27T20:43:05.525 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2022-01-27T20:43:14.737 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/dispatcher/supervisor.py", line 206, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/lock/ops.py", line 316, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi087.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2022-01-27T20:43:14.808 INFO:teuthology.nuke:Checking targets against current locks 2022-01-27T20:43:14.961 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-27T20:43:14.966 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-27T20:43:14.972 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-27T20:43:15.080 INFO:teuthology.orchestra.console:Power off smithi110 2022-01-27T20:43:15.107 INFO:teuthology.orchestra.console:Power off smithi087 2022-01-27T20:43:15.129 INFO:teuthology.orchestra.console:Power off smithi018 2022-01-27T20:43:15.277 INFO:teuthology.orchestra.console:Power off for smithi087 completed 2022-01-27T20:43:15.427 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com 2022-01-27T20:43:23.518 INFO:teuthology.orchestra.console:Power off for smithi110 completed 2022-01-27T20:43:23.526 INFO:teuthology.orchestra.console:Power off for smithi018 completed 2022-01-27T20:43:23.668 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2022-01-27T20:43:23.675 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2022-01-27T20:43:24.000 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/dispatcher/supervisor.py", line 52, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/dispatcher/supervisor.py", line 206, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/lock/ops.py", line 316, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi087.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds