2023-11-13T22:24:19.143 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-13T22:24:19.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T22:24:19.338 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4b919f9b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4b924ec670>, signals=[15])
2023-11-13T22:24:19.340 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging
2023-11-13T22:24:19.340 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T22:24:19.340 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-11-13T22:24:19.360 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging
2023-11-13T22:24:19.361 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T22:24:19.361 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server
2023-11-13T22:24:19.362 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"}
2023-11-13T22:24:19.385 INFO:teuthology.lock.ops:Start node 'smithi180.front.sepia.ceph.com' reimaging
2023-11-13T22:24:19.385 INFO:teuthology.lock.ops:Updating [smithi180.front.sepia.ceph.com]: reset os type and version on server
2023-11-13T22:24:19.386 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server
2023-11-13T22:24:19.387 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"}
2023-11-13T22:24:19.410 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /host {"name": "smithi180"}
2023-11-13T22:24:19.418 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-13T22:24:19.453 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-13T22:24:19.456 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-13T22:24:19.456 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 5}
2023-11-13T22:24:19.471 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-11-13T22:24:19.494 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-13T22:24:19.495 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 5}
2023-11-13T22:24:19.502 DEBUG:teuthology.provision.fog.smithi180:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-13T22:24:19.503 DEBUG:teuthology.provision.fog.smithi180:FOG request: PUT /host/285 {"imageID": 5}
2023-11-13T22:24:19.505 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6
2023-11-13T22:24:19.506 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:24:19.532 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.6
2023-11-13T22:24:19.533 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:24:19.550 INFO:teuthology.provision.fog.smithi180:Scheduling deploy of rhel 8.6
2023-11-13T22:24:19.550 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:24:19.614 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T22:24:19.620 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T22:24:19.645 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /tasktype {"name": "deploy"}
2023-11-13T22:24:19.652 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1}
2023-11-13T22:24:19.655 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1}
2023-11-13T22:24:19.682 DEBUG:teuthology.provision.fog.smithi180:FOG request: POST /host/285/task {"taskTypeID": 1}
2023-11-13T22:24:19.720 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:24:19.747 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:24:19.762 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:24:19.865 INFO:teuthology.orchestra.console.smithi007:Power off
2023-11-13T22:24:19.866 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T22:24:19.900 INFO:teuthology.orchestra.console.smithi137:Power off
2023-11-13T22:24:19.900 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T22:24:19.906 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-11-13T22:24:19.906 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:19.920 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off
2023-11-13T22:24:19.921 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:19.928 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-11-13T22:24:19.933 INFO:teuthology.orchestra.console.smithi180:Power off
2023-11-13T22:24:19.934 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T22:24:19.941 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-11-13T22:24:19.953 DEBUG:teuthology.orchestra.console.smithi180:power off output: Chassis Power Control: Down/Off
2023-11-13T22:24:19.954 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:19.976 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is on
2023-11-13T22:24:23.930 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:23.942 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:23.978 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:24.039 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-11-13T22:24:24.050 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-11-13T22:24:24.086 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is on
2023-11-13T22:24:28.042 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:28.051 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:28.087 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:28.152 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-11-13T22:24:28.161 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-11-13T22:24:28.195 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is off
2023-11-13T22:24:28.253 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-11-13T22:24:28.262 INFO:teuthology.orchestra.console.smithi137:Power off completed
2023-11-13T22:24:28.296 INFO:teuthology.orchestra.console.smithi180:Power off completed
2023-11-13T22:24:28.355 INFO:teuthology.orchestra.console.smithi007:Power on
2023-11-13T22:24:28.355 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T22:24:28.363 INFO:teuthology.orchestra.console.smithi137:Power on
2023-11-13T22:24:28.364 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T22:24:28.376 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On
2023-11-13T22:24:28.377 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:28.383 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On
2023-11-13T22:24:28.384 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:28.396 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-11-13T22:24:28.403 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-11-13T22:24:28.426 INFO:teuthology.orchestra.console.smithi180:Power on
2023-11-13T22:24:28.426 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-13T22:24:28.446 DEBUG:teuthology.orchestra.console.smithi180:power on output: Chassis Power Control: Up/On
2023-11-13T22:24:28.447 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:28.467 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is off
2023-11-13T22:24:32.401 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:32.408 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:32.468 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:32.510 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-11-13T22:24:32.516 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-11-13T22:24:32.576 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is on
2023-11-13T22:24:32.677 INFO:teuthology.orchestra.console.smithi180:Power on completed
2023-11-13T22:24:32.778 INFO:teuthology.provision.fog.smithi180:Waiting for deploy to finish
2023-11-13T22:24:32.778 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:24:36.515 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:36.521 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T22:24:36.623 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-11-13T22:24:36.629 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-11-13T22:24:36.724 INFO:teuthology.orchestra.console.smithi007:Power on completed
2023-11-13T22:24:36.730 INFO:teuthology.orchestra.console.smithi137:Power on completed
2023-11-13T22:24:36.826 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2023-11-13T22:24:36.826 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:24:36.831 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish
2023-11-13T22:24:36.831 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:24:47.942 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:24:51.987 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:24:51.994 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:25:03.105 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:25:07.150 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:25:07.155 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:25:18.286 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:25:22.312 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:25:22.322 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:25:33.445 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:25:37.473 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:25:37.481 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:25:48.682 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:25:52.686 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:25:52.693 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:26:03.948 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:26:07.906 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:26:07.909 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:26:19.336 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:26:23.278 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:26:23.282 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:26:34.914 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:26:39.155 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:26:39.194 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:26:50.478 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:26:57.435 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:26:58.452 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:27:10.945 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:27:16.618 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:27:18.499 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:27:37.359 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:27:43.202 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-11-13T22:27:44.217 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:27:49.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:27:54.742 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:28:07.675 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-11-13T22:28:12.759 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:28:13.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:28:16.730 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-11-13T22:28:22.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:28:25.819 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-11-13T22:28:26.401 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:28:31.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:28:34.906 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-11-13T22:28:40.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:28:48.626 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:28:56.081 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:29:04.515 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:29:22.266 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:29:24.032 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:29:40.924 WARNING:teuthology.provision.fog.smithi007:timed out
2023-11-13T22:29:46.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:29:47.036 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:29:47.622 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-13T22:29:47.623 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-13T22:29:47.946 INFO:teuthology.provision.fog.smithi007:Node is ready
2023-11-13T22:29:47.947 DEBUG:teuthology.orchestra.run.smithi007:> hostname
2023-11-13T22:29:47.966 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2023-11-13T22:29:47.967 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts
2023-11-13T22:29:48.026 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2023-11-13T22:29:48.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-11-13T22:29:48.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts
2023-11-13T22:29:48.167 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:29:48.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts
2023-11-13T22:29:48.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname
2023-11-13T22:29:48.328 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-11-13T22:29:48.397 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-11-13T22:29:48.455 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux"
2023-11-13T22:29:48.455 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)"
2023-11-13T22:29:48.455 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel"
2023-11-13T22:29:48.456 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora"
2023-11-13T22:29:48.456 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6"
2023-11-13T22:29:48.456 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-11-13T22:29:48.456 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-13T22:29:48.457 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-11-13T22:29:48.457 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-13T22:29:48.457 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/"
2023-11-13T22:29:48.457 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-13T22:29:48.458 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T22:29:48.458 INFO:teuthology.orchestra.run.smithi007.stdout:
2023-11-13T22:29:48.458 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-13T22:29:48.459 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-13T22:29:48.459 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-13T22:29:48.459 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-13T22:29:48.460 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2023-11-13T22:29:48.462 DEBUG:teuthology.parallel:result is None
2023-11-13T22:30:09.191 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:30:09.204 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:30:29.952 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:30:30.042 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:30:49.618 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:30:49.714 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None
2023-11-13T22:30:52.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:31:07.682 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:31:10.971 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:31:16.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:31:20.026 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:31:25.910 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:31:26.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:31:29.082 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:31:35.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:31:38.174 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:31:44.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:31:44.762 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:31:47.258 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:31:53.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:32:03.014 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:32:11.642 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:32:17.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:32:20.266 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:32:20.698 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:32:26.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:32:29.754 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137
2023-11-13T22:32:35.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-13T22:32:36.103 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-13T22:32:36.103 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-13T22:32:36.392 INFO:teuthology.provision.fog.smithi137:Node is ready
2023-11-13T22:32:36.392 DEBUG:teuthology.orchestra.run.smithi137:> hostname
2023-11-13T22:32:36.407 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com
2023-11-13T22:32:36.408 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts
2023-11-13T22:32:36.463 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137
2023-11-13T22:32:36.464 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2023-11-13T22:32:36.587 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts
2023-11-13T22:32:36.613 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts
2023-11-13T22:32:36.679 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname
2023-11-13T22:32:36.745 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137
2023-11-13T22:32:36.810 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release
2023-11-13T22:32:36.867 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux"
2023-11-13T22:32:36.868 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.6 (Ootpa)"
2023-11-13T22:32:36.868 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel"
2023-11-13T22:32:36.868 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora"
2023-11-13T22:32:36.868 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.6"
2023-11-13T22:32:36.868 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8"
2023-11-13T22:32:36.869 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-13T22:32:36.869 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31"
2023-11-13T22:32:36.869 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-13T22:32:36.869 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/"
2023-11-13T22:32:36.869 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-13T22:32:36.870 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-13T22:32:36.870 INFO:teuthology.orchestra.run.smithi137.stdout:
2023-11-13T22:32:36.870 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-13T22:32:36.870 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-13T22:32:36.871 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-13T22:32:36.871 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-13T22:32:36.871 INFO:teuthology.provision.fog.smithi137:Deploy complete!
2023-11-13T22:32:36.872 DEBUG:teuthology.parallel:result is None
2023-11-13T22:32:37.592 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:32:54.294 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:33:10.554 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:33:26.354 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:33:41.673 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:33:57.134 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:34:12.442 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:34:27.759 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:34:42.934 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:34:58.098 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:35:13.282 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:35:28.411 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:35:43.538 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:35:58.662 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:36:13.798 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:36:28.918 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:36:44.014 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:36:59.110 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:37:14.186 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:37:29.254 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:37:44.326 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:37:59.391 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:38:14.470 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:38:29.534 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:38:44.594 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:38:59.659 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:39:14.722 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:39:29.782 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:39:44.843 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:39:59.907 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:40:14.969 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:40:30.042 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:40:45.109 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:41:00.174 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:41:15.236 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:41:30.303 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:41:45.364 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:42:00.422 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:42:15.489 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:42:30.557 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:42:45.621 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:43:00.687 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:43:15.758 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:43:30.822 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:43:45.882 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:44:00.950 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:44:16.010 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:44:31.072 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:44:46.134 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:45:01.202 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:45:16.264 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:45:31.326 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:45:46.390 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:46:01.454 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:46:16.518 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:46:31.582 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:46:46.650 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:47:01.718 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:47:16.786 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:47:31.843 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:47:46.906 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:48:01.971 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:48:17.030 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:48:32.094 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:48:47.156 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:49:02.216 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:49:17.278 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:49:32.340 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:49:47.392 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:50:02.454 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:50:17.514 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:50:32.586 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:50:47.658 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:51:02.726 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:51:17.800 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:51:32.874 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:51:47.941 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:52:03.014 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:52:18.085 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:52:33.158 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:52:48.229 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:53:03.298 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:53:18.363 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:53:33.422 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:53:48.486 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:54:03.548 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:54:18.614 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:54:33.682 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:54:48.732 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:55:03.822 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:55:18.910 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:55:33.982 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:55:49.065 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:56:04.138 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:56:19.214 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:56:34.293 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:56:49.378 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:57:04.461 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:57:19.554 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:57:34.634 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:57:49.718 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:58:04.794 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:58:19.863 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:58:34.933 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:58:49.998 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:59:05.066 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:59:20.138 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:59:35.210 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T22:59:50.282 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:00:05.353 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:00:20.422 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:00:35.492 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:00:50.550 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:01:05.642 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:01:20.745 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:01:35.850 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:01:50.934 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:02:06.030 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:02:21.118 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:02:36.218 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:02:51.322 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:03:06.438 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:03:21.546 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:03:36.662 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:03:51.774 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:04:06.878 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:04:21.990 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:04:37.098 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:04:52.217 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:05:07.327 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:05:22.446 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:05:37.563 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:05:52.686 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:06:07.807 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:06:22.922 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:06:38.026 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:06:53.134 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:07:08.230 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:07:23.318 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:07:38.406 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:07:53.498 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:08:08.578 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:08:23.658 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:08:38.750 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:08:53.848 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:09:08.938 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:09:24.022 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:09:39.102 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:09:54.190 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:10:09.266 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:10:24.355 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:10:39.445 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:10:54.534 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:11:09.622 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:11:24.711 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:11:39.798 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:11:54.886 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:12:09.979 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:12:25.079 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:12:40.176 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:12:55.266 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:13:10.354 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:13:25.442 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:13:40.515 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:13:55.586 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:14:10.670 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:14:25.758 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:14:40.824 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:14:55.897 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:15:10.958 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:15:26.030 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:15:41.110 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:15:56.178 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:16:11.252 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:16:26.325 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:16:41.398 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:16:56.474 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:17:11.550 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:17:26.630 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:17:41.702 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:17:56.766 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:18:11.838 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:18:26.906 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:18:41.970 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:18:57.042 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:19:12.118 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:19:27.182 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:19:42.242 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:19:57.302 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:20:12.366 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:20:27.434 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:20:42.514 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:20:57.590 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:21:12.678 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:21:27.763 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:21:42.846 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:21:57.927 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:22:13.010 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:22:28.099 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:22:43.179 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:22:58.266 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:23:13.351 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:23:28.423 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:23:43.490 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:23:58.560 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:24:13.624 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:24:28.694 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:24:43.770 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:24:58.838 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:25:13.903 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:25:28.977 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:25:44.066 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:25:59.142 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:26:14.218 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:26:29.298 DEBUG:teuthology.provision.fog.smithi180:FOG request: GET /task/active None
2023-11-13T23:26:29.377 DEBUG:teuthology.provision.fog.smithi180:Canceling deploy task with ID 602692
2023-11-13T23:26:29.378 DEBUG:teuthology.provision.fog.smithi180:FOG request: DELETE /task/cancel {"id": 602692}
2023-11-13T23:26:29.471 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds
2023-11-13T23:26:29.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-13T23:26:29.600 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7b286ad6821a4c0c80cf267ce12bfee0
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds
2023-11-13T23:26:29.603 INFO:teuthology.nuke:Checking targets against current locks
2023-11-13T23:26:29.683 DEBUG:teuthology.nuke:shortname: smithi007
2023-11-13T23:26:29.684 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T23:26:29.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-13_22:23:04-smoke-reef-release-distro-default-smithi/7456483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 22:24:18.327905', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCu/SCmXIz7ZZY9yls78zkEpHTApRCAAOIVBSj8/Y8QZWjwFRoWyS809UDrchALvsiaWN8anGpgerIxGQ1KfLjo='}
2023-11-13T23:26:29.707 DEBUG:teuthology.nuke:shortname: smithi137
2023-11-13T23:26:29.707 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T23:26:29.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-13_22:23:04-smoke-reef-release-distro-default-smithi/7456483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 22:24:18.326470', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIUSBIJCVBtOAGCNHoOoDmv0PU/ERj+Mxjss9EThwDm2DIzNZwVtEgQBo/zQdkrDsMpU0Qn5DCAkutvOHhcbJHg='}
2023-11-13T23:26:29.731 DEBUG:teuthology.nuke:shortname: smithi180
2023-11-13T23:26:29.731 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-13T23:26:29.759 INFO:teuthology.orchestra.console.smithi007:Power off
2023-11-13T23:26:29.761 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T23:26:29.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi180.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-13_22:23:04-smoke-reef-release-distro-default-smithi/7456483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-13 22:24:18.328917', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClSicqGWHaveeEZnp0mgVeorreKCb08RuxmwX4YnKbLuI1W1APFQGrD2+YqYh/s4rJpzs+Seh2T1l9KgNkUaetLag/+zFsbsmVTwg6kKiiVQmZB9Zn4jVOmApmIGPmf7v6Plxd1o4r0FjWTeeS3dBWUds/rMclPGPtwb3UqVpczO5W712aV6t1BE47GYhAwhlq6t9DpVYWu1ddb0Yw30PQCJINx8nBTwhao8RnRBQv0cx+mOmWFfysK8xzlzEL2Hfx+P6tugt7NHAJyy/qHQkuMoofgPkjQje8chSmfltBERtpGlGlGuHiQJ/mTRmQl5XWdEeJNGHPn5Lx1QzxUVrKhsGB4CGoKHt6Mtsqurqo/5Rd5mHvTuOogj/oDdGWp1h/7ev7L0UAGqM0hymneGG9WHaQbEFeSx+g1EOJs+9c5R+SF5Pd3n7t+nAoIkqrVxSDliJRmjGRTk3YCBVebhdDVJt4rGh+818DwDXEjNNdz5G2ypX2D/ys/TJqQUuszP8='}
2023-11-13T23:26:29.785 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-11-13T23:26:29.785 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:29.808 INFO:teuthology.orchestra.console.smithi137:Power off
2023-11-13T23:26:29.809 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T23:26:29.822 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-11-13T23:26:29.831 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off
2023-11-13T23:26:29.832 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:29.847 INFO:teuthology.orchestra.console.smithi180:Power off
2023-11-13T23:26:29.847 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-13T23:26:29.857 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-11-13T23:26:29.870 DEBUG:teuthology.orchestra.console.smithi180:power off output: Chassis Power Control: Down/Off
2023-11-13T23:26:29.871 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:29.899 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is on
2023-11-13T23:26:33.826 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:33.858 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:33.901 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:33.936 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-11-13T23:26:33.968 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-11-13T23:26:34.012 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is on
2023-11-13T23:26:37.938 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:37.969 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:38.013 DEBUG:teuthology.orchestra.console.smithi180:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:38.050 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-11-13T23:26:38.079 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on
2023-11-13T23:26:38.123 DEBUG:teuthology.orchestra.console.smithi180:check power output: Chassis Power is off
2023-11-13T23:26:38.152 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-11-13T23:26:38.224 INFO:teuthology.orchestra.console.smithi180:Power off completed
2023-11-13T23:26:38.311 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com
2023-11-13T23:26:38.369 INFO:teuthology.lock.ops:unlocked: smithi180.front.sepia.ceph.com
2023-11-13T23:26:42.082 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-13T23:26:42.270 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off
2023-11-13T23:26:42.371 INFO:teuthology.orchestra.console.smithi137:Power off completed
2023-11-13T23:26:42.526 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com
2023-11-13T23:26:44.291 ERROR:teuthology.dispatcher.supervisor:Reimage failed 10 times ... marking machine down
2023-11-13T23:26:44.295 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 58, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/dispatcher/supervisor.py", line 228, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 86, in create
    self.wait_for_deploy_task(task_id)
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/provision/fog.py", line 259, in wait_for_deploy_task
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/contextutil.py", line 134, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (241) after waiting for 3600 seconds