2023-06-05T20:32:44.545 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-05T20:32:44.658 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-06-05T20:32:44.660 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-06-05T20:32:44.660 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-06-05T20:32:44.820 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 22.04 2023-06-05T20:32:45.392 INFO:teuthology.orchestra.console:Power off smithi084 2023-06-05T20:32:45.536 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2023-06-05T20:32:45.637 INFO:teuthology.orchestra.console:Power on smithi084 2023-06-05T20:32:54.109 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2023-06-05T20:32:54.210 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-06-05T20:37:51.664 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:38:00.720 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:38:09.776 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:38:18.832 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:38:27.888 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:38:36.944 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:38:53.296 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:02.352 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:11.408 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:20.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:29.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:38.640 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:47.728 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:39:56.784 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:40:05.840 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:40:14.896 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:40:23.952 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:40:33.008 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:40:42.064 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:40:51.120 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:00.176 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:09.232 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:18.288 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:27.344 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:36.400 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:45.456 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:41:54.512 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:03.568 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:12.624 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:21.680 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:30.736 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:39.792 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:48.848 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:42:57.904 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:43:06.960 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:43:16.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:43:25.104 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:43:34.160 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:43:43.216 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:43:52.272 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:01.328 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:10.384 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:19.440 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:28.528 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:37.584 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:46.640 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:44:55.696 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:04.752 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:13.808 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:22.864 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:31.920 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:40.976 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:50.032 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:45:59.088 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:46:08.144 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:46:17.200 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:46:26.256 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:46:35.312 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:46:44.368 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:46:53.424 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:02.480 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:11.536 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:20.592 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:29.648 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:38.704 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:47.760 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:47:56.816 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:48:05.872 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:48:14.932 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:48:24.016 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:48:33.072 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:48:42.160 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:48:51.216 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:00.304 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:09.360 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:18.416 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:27.476 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:36.560 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:45.616 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:49:54.672 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:03.728 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:12.784 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:21.840 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:30.896 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:39.952 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:49.008 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:50:58.096 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:51:07.152 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:51:16.208 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:51:25.264 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:51:34.320 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:51:43.376 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:51:52.432 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:01.488 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:10.544 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:19.600 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:28.656 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:37.744 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:46.800 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:55.860 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-06-05T20:52:55.862 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 272, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds 2023-06-05T20:52:55.945 INFO:teuthology.nuke:Checking targets against current locks 2023-06-05T20:52:55.972 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 272, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (101) after waiting for 600 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 56, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 234, in reimage nuke.nuke(ctx, True) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/nuke/__init__.py", line 248, in nuke if ctx.name and ctx.name not in status.get('description', ""): TypeError: argument of type 'NoneType' is not iterable