2023-06-21T17:20:58.518 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-21T17:20:58.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T17:20:58.520 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T17:20:58.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f12b79585e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f12b8b758b0>, signals=[15])
2023-06-21T17:20:58.710 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2023-06-21T17:20:58.711 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2023-06-21T17:20:58.711 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2023-06-21T17:20:58.733 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2023-06-21T17:20:58.733 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2023-06-21T17:20:58.734 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-06-21T17:20:58.735 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /host {"name": "smithi032"}
2023-06-21T17:20:58.758 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"}
2023-06-21T17:20:58.811 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-21T17:20:58.822 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-21T17:20:58.850 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-21T17:20:58.850 DEBUG:teuthology.provision.fog.smithi032:FOG request: PUT /host/137 {"imageID": 5}
2023-06-21T17:20:58.860 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-21T17:20:58.861 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 5}
2023-06-21T17:20:58.900 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6
2023-06-21T17:20:58.901 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:20:58.906 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of rhel 8.6
2023-06-21T17:20:58.906 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:20:58.950 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /tasktype {"name": "deploy"}
2023-06-21T17:20:58.965 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"}
2023-06-21T17:20:58.985 DEBUG:teuthology.provision.fog.smithi032:FOG request: POST /host/137/task {"taskTypeID": 1}
2023-06-21T17:20:59.003 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1}
2023-06-21T17:20:59.034 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:20:59.049 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:20:59.141 INFO:teuthology.orchestra.console:Power off smithi151
2023-06-21T17:20:59.142 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T17:20:59.160 INFO:teuthology.orchestra.console:Power off smithi032
2023-06-21T17:20:59.161 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T17:20:59.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:20:59.181 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:03.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:03.203 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:07.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:07.316 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:07.519 INFO:teuthology.orchestra.console:Power off for smithi151 completed
2023-06-21T17:21:07.528 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2023-06-21T17:21:07.621 INFO:teuthology.orchestra.console:Power on smithi151
2023-06-21T17:21:07.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-21T17:21:07.631 INFO:teuthology.orchestra.console:Power on smithi032
2023-06-21T17:21:07.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-21T17:21:07.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:07.656 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:11.674 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:11.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:15.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:15.797 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T17:21:15.999 INFO:teuthology.orchestra.console:Power on for smithi151 completed
2023-06-21T17:21:16.034 INFO:teuthology.orchestra.console:Power on for smithi032 completed
2023-06-21T17:21:16.102 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2023-06-21T17:21:16.102 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:21:16.135 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2023-06-21T17:21:16.135 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:21:31.188 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:21:31.202 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:21:46.268 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:21:46.270 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:22:01.344 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:22:01.346 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:22:16.424 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:22:16.427 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:22:31.511 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:22:31.513 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:22:46.600 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:22:46.601 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:23:01.668 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:23:01.670 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:23:16.768 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:23:16.770 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:23:31.858 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:23:31.860 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:23:46.948 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:23:46.949 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:24:02.032 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-06-21T17:24:02.034 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:24:02.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:05.168 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:24:11.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:14.260 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:24:17.112 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:24:20.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:23.348 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:24:29.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:32.180 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:24:32.432 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:24:38.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:41.488 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:24:47.251 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:24:47.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:50.544 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:24:56.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:24:59.604 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:25:02.312 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:25:05.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:25:08.688 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-06-21T17:25:14.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:25:17.368 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:25:32.444 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:25:47.524 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:26:02.600 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:26:14.704 WARNING:teuthology.provision.fog.smithi151:timed out
2023-06-21T17:26:17.664 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:26:20.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-21T17:26:21.029 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-21T17:26:21.030 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-21T17:26:21.328 INFO:teuthology.provision.fog.smithi151:Node is ready
2023-06-21T17:26:21.329 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2023-06-21T17:26:21.347 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151
2023-06-21T17:26:21.347 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151 /etc/hosts
2023-06-21T17:26:21.403 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2023-06-21T17:26:21.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-06-21T17:26:21.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151/smithi151/g' /etc/hosts
2023-06-21T17:26:21.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2023-06-21T17:26:21.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151/smithi151/g' /etc/hostname
2023-06-21T17:26:21.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-06-21T17:26:21.761 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-06-21T17:26:21.818 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux"
2023-06-21T17:26:21.818 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-06-21T17:26:21.819 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/"
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-21T17:26:21.820 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-21T17:26:21.821 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2023-06-21T17:26:21.823 DEBUG:teuthology.parallel:result is None
2023-06-21T17:26:32.728 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:26:47.793 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:27:02.856 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:27:17.936 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:27:33.010 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:27:48.084 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:28:03.160 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:28:18.236 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:28:33.296 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:28:48.372 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:29:03.444 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:29:18.516 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:29:33.605 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:29:48.668 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:30:03.740 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:30:18.808 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:30:33.876 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:30:48.944 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:31:04.016 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:31:19.088 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:31:34.172 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:31:49.238 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:32:04.308 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:32:19.376 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:32:34.440 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:32:49.505 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:33:04.576 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:33:19.641 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:33:34.712 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:33:49.771 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:34:04.835 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:34:19.904 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:34:34.980 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:34:50.052 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:35:05.120 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:35:20.204 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:35:35.278 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:35:50.352 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:36:05.424 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:36:20.496 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:36:35.588 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:36:50.668 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:37:05.747 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:37:20.820 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:37:35.892 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:37:50.963 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:38:06.028 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:38:21.100 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:38:36.180 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:38:51.260 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:39:06.334 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:39:21.400 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:39:36.459 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:39:51.528 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:40:06.592 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:40:21.668 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:40:36.752 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:40:51.840 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:41:06.928 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:41:22.009 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:41:37.092 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:41:52.172 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:42:07.242 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:42:22.324 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:42:37.408 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:42:52.496 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:43:07.580 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:43:22.662 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:43:37.728 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:43:52.805 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:44:07.864 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:44:22.941 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:44:37.996 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:44:53.060 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:45:08.124 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:45:23.192 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:45:38.256 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:45:53.330 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:46:08.396 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:46:23.456 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:46:38.520 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:46:53.584 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:47:08.668 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:47:23.744 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:47:38.828 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:47:53.908 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:48:08.996 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:48:24.076 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:48:39.164 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:48:54.256 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:49:09.360 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:49:24.458 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:49:39.540 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:49:54.612 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:50:09.701 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:50:24.780 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:50:39.856 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:50:54.924 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:51:09.992 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:51:25.056 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:51:40.124 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:51:55.192 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:52:10.274 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:52:25.348 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:52:40.432 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:52:55.508 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:53:10.592 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:53:25.672 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:53:40.760 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:53:55.841 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:54:10.932 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:54:26.016 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:54:41.092 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:54:56.176 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:55:11.257 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:55:26.320 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:55:41.385 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:55:56.444 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:56:11.504 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:56:26.572 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:56:41.640 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:56:56.704 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:57:11.776 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:57:26.852 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:57:41.928 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:57:57.016 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:58:12.096 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:58:27.180 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:58:42.272 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:58:57.356 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:59:12.432 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:59:27.502 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:59:42.580 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T17:59:57.660 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:00:12.732 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:00:27.807 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:00:42.881 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:00:57.952 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:01:13.032 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:01:28.108 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:01:43.196 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:01:58.280 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:02:13.356 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:02:28.444 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:02:43.532 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:02:58.608 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:03:13.708 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:03:28.804 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:03:43.886 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:03:58.973 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:04:14.051 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:04:29.127 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:04:44.208 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:04:59.276 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:05:14.348 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:05:29.424 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:05:44.496 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:05:59.568 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:06:14.633 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:06:29.696 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:06:44.768 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:06:59.836 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:07:14.900 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:07:29.964 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:07:45.028 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:08:00.104 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:08:15.172 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:08:30.244 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:08:45.308 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:09:00.376 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:09:15.444 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:09:30.521 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:09:45.592 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:10:00.664 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:10:15.732 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:10:30.792 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:10:45.866 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:11:00.944 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:11:16.020 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:11:31.100 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:11:46.172 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:12:01.248 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:12:16.324 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:12:31.400 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:12:46.488 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:13:01.568 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:13:16.656 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:13:31.770 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:13:46.872 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:14:01.952 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:14:17.040 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:14:32.116 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:14:47.190 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:15:02.256 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:15:17.324 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:15:32.392 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:15:47.473 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:16:02.556 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:16:17.624 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:16:32.693 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:16:47.764 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:17:02.837 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:17:17.908 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:17:32.984 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:17:48.052 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:18:03.124 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:18:18.222 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:18:33.308 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:18:48.404 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:19:03.501 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:19:18.596 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:19:33.696 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:19:48.779 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:20:03.868 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:20:18.972 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:20:34.068 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:20:49.164 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:21:04.252 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:21:19.336 DEBUG:teuthology.provision.fog.smithi032:FOG request: GET /task/active None
2023-06-21T18:21:19.406 DEBUG:teuthology.provision.fog.smithi032:Canceling deploy task with ID 333490
2023-06-21T18:21:19.406 DEBUG:teuthology.provision.fog.smithi032:FOG request: DELETE /task/cancel {"id": 333490}
2023-06-21T18:21:19.504 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds
2023-06-21T18:21:19.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-21T18:21:19.509 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-21T18:21:19.604 INFO:teuthology.nuke:Checking targets against current locks
2023-06-21T18:21:19.657 DEBUG:teuthology.nuke:shortname: smithi032
2023-06-21T18:21:19.658 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-21T18:21:19.687 DEBUG:teuthology.nuke:shortname: smithi151
2023-06-21T18:21:19.688 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-21T18:21:19.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-21_14:39:10-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7309894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 17:20:57.703425', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4Dta/d+h/S8p/6ohR5D2gdSDm3sbEDTNPbPnLO9slns/80pWAPBPCrZy84yShgxv4lRNzGceAvoKrG9CJ11q/RFrQYj2VKhkA82+xYeWYRnVbBgaJtHtsp3EEpUktbLcu7qOUNpJ6Np+wm6Ej/mCSWok6NCJRr6ZlDP0yh8rP30X01Ms2QEgz0rwqpkzNR4vjZJWfeH71obWS5rVmOGWwVsckkI/hX6fIoUNR+bN76ZL4jXiSqovHHGxbQ+BBxdRJ2UoWpgPfWumJUCEyeARndDqAMgBc3tsrivIlQinXqSzQ2/GmXAkklpnR+jvlZV7MHOVtt3oGu/Dgj8gy8ZoEGD2KDdIWWGAxC1A3JuIZBz6sSV+xsGxTciy9pPDytuiR34hm0joKsPgCO/IS0Riq4Io3gFRjq5soBbdVo9oLnxKV/SDF21uRBZyJKz3/sct0wKLMdgjBSmXx65tFpGx6WHhja2a10fpAK5lmRFjYO71aY1w6Xy6NGLkAhz5Cujk='}
2023-06-21T18:21:19.714 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-21_14:39:10-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7309894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-21 17:20:57.705019', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvC935jspSIM6kXLkvK4WF2+jMJd/MzOSERNrW0qGjMieNEqf6OiJoSSWwK2j2Dak5uST2IEbmGt0mbp7lQv4foKL3XPqbNHsmok/5wF9qNXsrc9KqOKFPeG2RZPcIV4/V5pEyUrzMWUW+KqFG+0mk7vKfancjVgHoFecL+K8jeKmuooGBVS/Hd7c3gv6PDVzkcCBGjDi7CQXgMdnvxMZg4pSlsx+xAgLs6pM5c9l4qOIFCFvIlXA+XcvWlH7E8bQnd9oxmYAj+PS7IjsJHFas/vaxgsiarwridNEIUbaGIVE3XPVMQs7g/40gTIYBeashN3xTylpv7Hj4QLX0SY9HrRnYyfT7bIb4AOEwPXPK9bfZ7vYXOfj+Fdk+NJk7/aRrQZa1ydWzcYtQeh9OMqqI7K9cDp3daU9kuamFbrHQXJj9qtKJ9mA8wxutBXabZQBCq6pj4aXJd3uHHW/Xbu8qWOufgM1DpZBnof2Zk1Toq0q/gSzfn7txu1bl0plSpZU='}
2023-06-21T18:21:19.735 INFO:teuthology.orchestra.console:Power off smithi032
2023-06-21T18:21:19.736 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T18:21:19.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T18:21:19.777 INFO:teuthology.orchestra.console:Power off smithi151
2023-06-21T18:21:19.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-21T18:21:19.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T18:21:23.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T18:21:23.824 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T18:21:24.000 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2023-06-21T18:21:24.149 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2023-06-21T18:21:27.940 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-21T18:21:28.150 INFO:teuthology.orchestra.console:Power off for smithi151 completed
2023-06-21T18:21:28.309 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com
2023-06-21T18:21:28.597 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds