2023-03-04T10:26:02.475 INFO:root:teuthology version: 0.0.1.dev51+ga2dfb05 2023-03-04T10:26:02.667 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-03-04T10:26:02.668 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-03-04T10:26:02.669 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-03-04T10:26:02.690 INFO:teuthology.lock.ops:Node 'smithi140.front.sepia.ceph.com' reimaging is complete 2023-03-04T10:26:02.690 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-03-04T10:26:02.691 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-03-04T10:26:02.691 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-03-04T10:26:02.714 INFO:teuthology.lock.ops:Node 'smithi143.front.sepia.ceph.com' reimaging is complete 2023-03-04T10:26:02.715 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging 2023-03-04T10:26:02.715 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server 2023-03-04T10:26:02.715 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-03-04T10:26:02.739 INFO:teuthology.lock.ops:Node 'smithi151.front.sepia.ceph.com' reimaging is complete 2023-03-04T10:26:02.844 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-03-04T10:26:02.880 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.6 2023-03-04T10:26:02.888 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of rhel 8.6 2023-03-04T10:26:03.085 INFO:teuthology.orchestra.console:Power off smithi140 2023-03-04T10:26:03.133 INFO:teuthology.orchestra.console:Power off smithi143 2023-03-04T10:26:03.149 INFO:teuthology.orchestra.console:Power off smithi151 2023-03-04T10:26:03.227 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-03-04T10:26:03.328 INFO:teuthology.orchestra.console:Power on smithi140 2023-03-04T10:26:11.527 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-03-04T10:26:11.629 INFO:teuthology.orchestra.console:Power on smithi151 2023-03-04T10:26:11.700 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-03-04T10:26:11.801 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-03-04T10:26:15.631 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2023-03-04T10:26:15.733 INFO:teuthology.orchestra.console:Power on smithi143 2023-03-04T10:26:19.991 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2023-03-04T10:26:19.999 INFO:teuthology.orchestra.console:Power on for smithi151 completed 2023-03-04T10:26:20.093 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-03-04T10:26:20.101 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish 2023-03-04T10:28:53.961 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-04T10:28:57.698 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-03-04T10:29:03.017 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-04T10:29:08.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:29:12.073 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-04T10:29:18.057 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:29:21.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-04T10:29:27.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:29:30.181 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-04T10:29:36.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:29:39.237 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-04T10:29:45.221 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:29:54.277 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:29:58.702 WARNING:teuthology.provision.fog:timed out 2023-03-04T10:30:03.337 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:30:27.849 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:30:36.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:30:45.240 WARNING:teuthology.provision.fog:timed out 2023-03-04T10:30:45.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-03-04T10:30:51.558 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-04T10:30:51.856 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-03-04T10:30:51.875 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-03-04T10:30:51.934 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-03-04T10:30:52.287 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-04T10:30:52.405 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-03-04T10:30:52.561 INFO:teuthology.provision.fog.smithi151:Node is ready 2023-03-04T10:30:52.578 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com 2023-03-04T10:30:52.635 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151 2023-03-04T10:30:53.054 INFO:teuthology.provision.fog.smithi151:Deploy complete! 2023-03-04T10:31:04.708 WARNING:teuthology.provision.fog:timed out 2023-03-04T10:31:29.029 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:31:38.085 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:31:47.141 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:31:56.229 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:05.289 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:14.341 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:23.401 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:32.453 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:41.509 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:50.569 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:32:59.621 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:33:08.677 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:33:17.733 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:33:26.793 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:33:35.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:33:44.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:33:53.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:03.013 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:12.069 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:21.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:30.187 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:39.273 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:48.361 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:34:57.413 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:35:06.469 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:35:15.525 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:35:24.585 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:35:33.637 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:35:42.697 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:35:51.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:00.809 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:09.865 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:18.921 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:27.973 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:37.029 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:46.085 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:36:55.141 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:04.201 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:13.253 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:22.309 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:31.365 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:40.421 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:49.477 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:37:58.533 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:38:07.593 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:38:16.645 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:38:25.701 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:38:34.761 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:38:43.816 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:38:52.869 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:01.925 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:10.981 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:20.041 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:29.093 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:38.153 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:47.209 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:39:56.261 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:05.317 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:14.377 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:23.429 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:32.485 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:41.541 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:50.597 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:40:59.653 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:41:08.713 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:41:17.765 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:41:26.821 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:41:35.877 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:41:44.933 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:41:53.993 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:03.049 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:12.105 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:21.157 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:30.217 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:39.269 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:48.325 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:42:57.385 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:43:06.438 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:43:15.493 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:43:24.553 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:43:33.605 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:43:42.661 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:43:51.717 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:00.773 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:09.833 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:18.885 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:27.945 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:36.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:46.053 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:44:55.113 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:04.165 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:13.221 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:22.277 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:31.333 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:40.389 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:49.445 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:45:58.501 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:46:07.557 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-03-04T10:46:07.559 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/dispatcher/supervisor.py", line 209, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/lock/ops.py", line 324, in reimage_machines log.info("Node '%s' reimaging is complete", machine) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/provision/__init__.py", line 39, in reimage return obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/provision/fog.py", line 271, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2023-03-04T10:46:07.629 INFO:teuthology.nuke:Checking targets against current locks 2023-03-04T10:46:07.689 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-04T10:46:07.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-04T10:46:07.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-04T10:46:07.761 INFO:teuthology.orchestra.console:Power off smithi140 2023-03-04T10:46:07.777 INFO:teuthology.orchestra.console:Power off smithi143 2023-03-04T10:46:07.820 INFO:teuthology.orchestra.console:Power off smithi151 2023-03-04T10:46:16.158 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2023-03-04T10:46:16.312 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-03-04T10:46:20.265 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-03-04T10:46:20.298 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-03-04T10:46:20.419 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-03-04T10:46:20.443 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com 2023-03-04T10:46:20.939 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/dispatcher/supervisor.py", line 52, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/dispatcher/supervisor.py", line 209, in reimage reimaged = reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/lock/ops.py", line 324, in reimage_machines log.info("Node '%s' reimaging is complete", machine) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/provision/__init__.py", line 39, in reimage return obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/provision/fog.py", line 271, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_a2dfb0599b24ec4a1585108a2792a4567ce0a378/teuthology/contextutil.py", line 135, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds