2023-06-05T20:32:18.561 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-05T20:32:18.690 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-06-05T20:32:18.691 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-06-05T20:32:18.691 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-06-05T20:32:18.718 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-06-05T20:32:18.718 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-06-05T20:32:18.718 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-06-05T20:32:18.855 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.6 2023-06-05T20:32:18.897 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of rhel 8.6 2023-06-05T20:32:19.159 INFO:teuthology.orchestra.console:Power off smithi053 2023-06-05T20:32:19.174 INFO:teuthology.orchestra.console:Power off smithi117 2023-06-05T20:32:27.530 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-06-05T20:32:27.631 INFO:teuthology.orchestra.console:Power on smithi053 2023-06-05T20:32:31.655 INFO:teuthology.orchestra.console:Power off for smithi117 completed 2023-06-05T20:32:31.757 INFO:teuthology.orchestra.console:Power on smithi117 2023-06-05T20:32:35.998 INFO:teuthology.orchestra.console:Power on for smithi053 completed 2023-06-05T20:32:36.006 INFO:teuthology.orchestra.console:Power on for smithi117 completed 2023-06-05T20:32:36.099 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-06-05T20:32:36.106 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-06-05T20:35:12.880 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:35:21.968 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:35:31.024 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:35:40.080 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:35:49.140 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:35:58.224 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:36:07.282 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:36:16.336 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:36:25.392 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:36:34.448 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:36:43.504 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-06-05T20:37:49.518 WARNING:teuthology.provision.fog:timed out 2023-06-05T20:37:55.854 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-05T20:37:56.161 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-06-05T20:37:56.179 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-06-05T20:37:56.238 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-06-05T20:37:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-06-05T20:37:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)" 2023-06-05T20:37:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-06-05T20:37:56.670 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-05T20:37:56.671 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-05T20:37:56.672 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-06-05T20:37:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-05T20:37:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-05T20:37:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-05T20:37:56.672 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-05T20:37:56.673 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-06-05T21:02:49.222 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 86, in create self.wait_for_deploy_task(task_id) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 256, in wait_for_deploy_task while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (121) after waiting for 1800 seconds 2023-06-05T21:02:49.325 INFO:teuthology.nuke:Checking targets against current locks 2023-06-05T21:02:49.349 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 226, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 86, in create self.wait_for_deploy_task(task_id) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/provision/fog.py", line 256, in wait_for_deploy_task while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (121) after waiting for 1800 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 56, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/dispatcher/supervisor.py", line 234, in reimage nuke.nuke(ctx, True) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/nuke/__init__.py", line 248, in nuke if ctx.name and ctx.name not in status.get('description', ""): TypeError: argument of type 'NoneType' is not iterable