2023-06-29T21:14:10.660 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39
2023-06-29T21:14:10.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T21:14:10.662 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T21:14:10.821 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbe717e2670>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbe7115dc10>, signals=[15])
2023-06-29T21:14:10.823 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-06-29T21:14:10.823 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-06-29T21:14:10.824 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-06-29T21:14:10.852 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-06-29T21:14:10.928 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-06-29T21:14:10.970 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_8.stream (ID 3)
2023-06-29T21:14:10.971 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 3}
2023-06-29T21:14:11.031 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.stream
2023-06-29T21:14:11.034 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:14:11.098 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-06-29T21:14:11.137 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-06-29T21:14:11.198 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:14:11.297 INFO:teuthology.orchestra.console:Power off smithi079
2023-06-29T21:14:11.298 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-29T21:14:11.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T21:14:15.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T21:14:19.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T21:14:19.705 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2023-06-29T21:14:19.807 INFO:teuthology.orchestra.console:Power on smithi079
2023-06-29T21:14:19.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-29T21:14:19.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T21:14:23.870 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T21:14:27.984 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-29T21:14:28.198 INFO:teuthology.orchestra.console:Power on for smithi079 completed
2023-06-29T21:14:28.299 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-06-29T21:14:28.300 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:14:43.384 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:14:58.460 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:15:13.558 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:15:28.648 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:15:43.744 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:15:58.838 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:16:13.932 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:16:29.010 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:16:44.092 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:16:59.160 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:17:14.236 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:17:29.310 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:17:44.383 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:17:59.457 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:18:14.533 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:18:29.612 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:18:44.694 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:18:59.764 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:19:14.844 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:19:29.930 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:19:45.009 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:20:00.092 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:20:15.172 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:20:30.261 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:20:45.344 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:21:00.422 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:21:15.496 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:21:30.575 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:21:45.652 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:22:00.732 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:22:15.800 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:22:30.873 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:22:45.962 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:23:01.038 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:23:16.118 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:23:31.196 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:23:46.275 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:24:01.355 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:24:16.433 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:24:31.512 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:24:46.589 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:25:01.664 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:25:16.738 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:25:31.815 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:25:46.882 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:26:01.949 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:26:17.015 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:26:32.087 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:26:47.150 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:27:02.227 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:27:17.312 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:27:32.379 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:27:47.456 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:28:02.524 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:28:17.600 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:28:32.676 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:28:47.754 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:29:02.832 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:29:17.912 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:29:32.976 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:29:48.056 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:30:03.133 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:30:18.205 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:30:33.280 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:30:48.359 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:31:03.434 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:31:18.507 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:31:33.579 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:31:48.652 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:32:03.724 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:32:18.801 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:32:33.879 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:32:48.957 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:33:04.024 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:33:19.090 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:33:34.167 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:33:49.244 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:34:04.316 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:34:19.392 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:34:34.477 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:34:49.557 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:35:04.632 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:35:19.711 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:35:34.787 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:35:49.868 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:36:04.953 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:36:20.042 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:36:35.122 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:36:50.191 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:37:05.280 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:37:20.357 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:37:35.437 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:37:50.512 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:38:05.594 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:38:20.660 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:38:35.727 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:38:50.790 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:39:05.867 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:39:20.933 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:39:36.012 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:39:51.080 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:40:06.156 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:40:21.232 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:40:36.308 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:40:51.396 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:41:06.463 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:41:21.540 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:41:36.615 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:41:51.692 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:42:06.766 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:42:21.836 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:42:36.915 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:42:51.992 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:43:07.061 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:43:22.131 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:43:37.201 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:43:52.280 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:44:07.347 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:44:22.426 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:44:37.501 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:44:52.578 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:45:07.645 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:45:22.720 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:45:37.800 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:45:52.880 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:46:07.959 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:46:23.039 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:46:38.112 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:46:53.189 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:47:08.262 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:47:23.339 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:47:38.409 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:47:53.487 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:48:08.568 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:48:23.636 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:48:38.707 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:48:53.783 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:49:08.848 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:49:23.917 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:49:38.987 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:49:54.065 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:50:09.145 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:50:24.215 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:50:39.290 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:50:54.365 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:51:09.440 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:51:24.511 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:51:39.591 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:51:54.671 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:52:09.747 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:52:24.825 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:52:39.890 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:52:54.963 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:53:10.037 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:53:25.110 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:53:40.188 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:53:55.262 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:54:10.337 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:54:25.423 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:54:40.497 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:54:55.578 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:55:10.659 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:55:25.725 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:55:40.794 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:55:55.872 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:56:10.952 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:56:26.032 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:56:41.109 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:56:56.182 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:57:11.258 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:57:26.323 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:57:41.391 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:57:56.474 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:58:11.551 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:58:26.628 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:58:41.701 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:58:56.769 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:59:11.840 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:59:26.915 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:59:42.004 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T21:59:57.078 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:00:12.160 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:00:27.232 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:00:42.304 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:00:57.396 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:01:12.453 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:01:27.524 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:01:42.597 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:01:57.684 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:02:12.760 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:02:27.828 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:02:42.894 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:02:57.967 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:03:13.056 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:03:28.148 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:03:43.232 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:03:58.310 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:04:13.376 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:04:28.455 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:04:43.532 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:04:58.608 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:05:13.668 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:05:28.744 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:05:43.819 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:05:58.900 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:06:13.968 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:06:29.044 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:06:44.112 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:06:59.191 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:07:14.258 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:07:29.340 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:07:44.432 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:07:59.508 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:08:14.568 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:08:29.644 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:08:44.716 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:08:59.804 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:09:14.868 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:09:29.960 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:09:45.036 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:10:00.105 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:10:15.175 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:10:30.253 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:10:45.332 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:11:00.415 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:11:15.478 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:11:30.564 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:11:45.640 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:12:00.712 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:12:15.784 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:12:30.875 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:12:45.951 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:13:01.018 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:13:16.099 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:13:31.184 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:13:46.258 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:14:01.330 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:14:16.396 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:14:31.471 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-06-29T22:14:31.527 DEBUG:teuthology.provision.fog.smithi079:Canceling deploy task with ID 355415
2023-06-29T22:14:31.528 DEBUG:teuthology.provision.fog.smithi079:FOG request: DELETE /task/cancel {"id": 355415}
2023-06-29T22:14:31.577 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds
2023-06-29T22:14:31.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-29T22:14:31.578 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-29T22:14:31.657 INFO:teuthology.nuke:Checking targets against current locks
2023-06-29T22:14:31.685 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/dispatcher/supervisor.py", line 235, in reimage
    nuke.nuke(ctx, True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/teuthology/nuke/__init__.py", line 248, in nuke
    if ctx.name and ctx.name not in status.get('description', ""):
TypeError: argument of type 'NoneType' is not iterable