2021-11-04T00:00:31.403 INFO:root:teuthology version: 1.1.0-c56135d1 2021-11-04T00:00:31.556 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging 2021-11-04T00:00:31.558 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server 2021-11-04T00:00:31.558 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-11-04T00:00:31.576 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete 2021-11-04T00:00:31.576 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging 2021-11-04T00:00:31.576 INFO:teuthology.lock.ops:Updating [ubuntu@smithi171.front.sepia.ceph.com]: reset os type and version on server 2021-11-04T00:00:31.577 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2021-11-04T00:00:31.595 INFO:teuthology.lock.ops:Node 'ubuntu@smithi171.front.sepia.ceph.com' reimaging is complete 2021-11-04T00:00:31.595 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging 2021-11-04T00:00:31.595 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server 2021-11-04T00:00:31.596 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2021-11-04T00:00:31.613 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete 2021-11-04T00:00:31.764 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.4 2021-11-04T00:00:31.805 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of rhel 8.4 2021-11-04T00:00:31.819 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of rhel 8.4 2021-11-04T00:00:32.103 INFO:teuthology.orchestra.console:Power off smithi134 2021-11-04T00:00:32.118 INFO:teuthology.orchestra.console:Power off smithi171 2021-11-04T00:00:32.164 INFO:teuthology.orchestra.console:Power off smithi197 2021-11-04T00:00:32.274 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2021-11-04T00:00:32.306 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2021-11-04T00:00:32.376 INFO:teuthology.orchestra.console:Power on smithi171 2021-11-04T00:00:32.407 INFO:teuthology.orchestra.console:Power on smithi197 2021-11-04T00:00:36.631 INFO:teuthology.orchestra.console:Power on for smithi171 completed 2021-11-04T00:00:36.732 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2021-11-04T00:00:40.483 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-11-04T00:00:40.585 INFO:teuthology.orchestra.console:Power on smithi134 2021-11-04T00:00:40.773 INFO:teuthology.orchestra.console:Power on for smithi197 completed 2021-11-04T00:00:40.874 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish 2021-11-04T00:00:48.952 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2021-11-04T00:00:49.054 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2021-11-04T00:04:49.782 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-04T00:05:05.169 INFO:teuthology.provision.fog.smithi197:Node is ready 2021-11-04T00:05:05.188 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com 2021-11-04T00:05:05.247 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2021-11-04T00:05:05.580 INFO:teuthology.provision.fog.smithi197:Deploy complete! 2021-11-04T00:05:38.532 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-04T00:05:38.745 INFO:teuthology.provision.fog.smithi134:Node is ready 2021-11-04T00:05:38.760 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2021-11-04T00:05:38.817 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2021-11-04T00:05:39.138 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2021-11-04T00:05:41.203 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-04T00:05:41.411 INFO:teuthology.provision.fog.smithi171:Node is ready 2021-11-04T00:05:41.426 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com 2021-11-04T00:05:41.481 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2021-11-04T00:05:41.795 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2021-11-04T00:05:50.993 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/lock/ops.py", line 316, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi197.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds 2021-11-04T00:05:51.061 INFO:teuthology.nuke:Checking targets against current locks 2021-11-04T00:05:51.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-04T00:05:51.201 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-04T00:05:51.205 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-04T00:05:51.288 INFO:teuthology.orchestra.console:Power off smithi171 2021-11-04T00:05:51.305 INFO:teuthology.orchestra.console:Power off smithi134 2021-11-04T00:05:51.317 INFO:teuthology.orchestra.console:Power off smithi197 2021-11-04T00:05:51.465 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2021-11-04T00:05:51.674 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com 2021-11-04T00:05:59.677 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-11-04T00:05:59.693 INFO:teuthology.orchestra.console:Power off for smithi171 completed 2021-11-04T00:05:59.863 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2021-11-04T00:05:59.884 INFO:teuthology.lock.ops:unlocked: smithi171.front.sepia.ceph.com 2021-11-04T00:05:59.885 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology-dispatcher", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology-dispatcher')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/scripts/dispatcher.py", line 33, in main teuthology.dispatcher.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/dispatcher/__init__.py", line 61, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/dispatcher/supervisor.py", line 50, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/dispatcher/supervisor.py", line 163, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/lock/ops.py", line 316, in reimage_machines reimaged = do_update_keys(list(reimaged.keys()))[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/lock/ops.py", line 283, in do_update_keys keys_dict = misc.ssh_keyscan(machines, _raise=_raise) File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/misc.py", line 1103, in ssh_keyscan while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'ssh_keyscan smithi197.front.sepia.ceph.com' reached maximum tries (5) after waiting for 5 seconds