2023-06-28T11:25:27.446 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a
2023-06-28T11:25:27.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T11:25:27.448 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T11:25:57.039 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f05c77d86a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f05c783d670>, signals=[15])
2023-06-28T11:25:57.041 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging
2023-06-28T11:25:57.042 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T11:25:57.043 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server
2023-06-28T11:26:02.030 INFO:teuthology.lock.ops:Start node 'smithi182.front.sepia.ceph.com' reimaging
2023-06-28T11:26:02.030 INFO:teuthology.lock.ops:Updating [smithi182.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T11:26:02.030 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server
2023-06-28T11:26:02.032 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /host {"name": "smithi177"}
2023-06-28T11:26:02.054 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2023-06-28T11:26:02.054 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2023-06-28T11:26:02.055 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-06-28T11:26:02.056 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /host {"name": "smithi182"}
2023-06-28T11:26:02.079 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"}
2023-06-28T11:26:02.094 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-28T11:26:02.128 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-28T11:26:02.134 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-28T11:26:02.135 DEBUG:teuthology.provision.fog.smithi177:FOG request: PUT /host/282 {"imageID": 5}
2023-06-28T11:26:02.144 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-06-28T11:26:02.174 DEBUG:teuthology.provision.fog.smithi182:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-28T11:26:02.175 DEBUG:teuthology.provision.fog.smithi182:FOG request: PUT /host/287 {"imageID": 5}
2023-06-28T11:26:02.178 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of rhel 8.6
2023-06-28T11:26:02.179 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-06-28T11:26:02.184 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_rhel_8.6 (ID 5)
2023-06-28T11:26:02.185 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 5}
2023-06-28T11:26:02.221 INFO:teuthology.provision.fog.smithi182:Scheduling deploy of rhel 8.6
2023-06-28T11:26:02.221 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:26:02.224 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of rhel 8.6
2023-06-28T11:26:02.224 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:26:02.243 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T11:26:02.280 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T11:26:07.288 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /tasktype {"name": "deploy"}
2023-06-28T11:26:07.290 DEBUG:teuthology.provision.fog.smithi177:FOG request: POST /host/282/task {"taskTypeID": 1}
2023-06-28T11:26:17.338 DEBUG:teuthology.provision.fog.smithi182:FOG request: POST /host/287/task {"taskTypeID": 1}
2023-06-28T11:26:22.346 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-06-28T11:26:22.347 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1}
2023-06-28T11:26:27.409 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:26:27.412 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:26:31.785 INFO:teuthology.orchestra.console:Power off smithi182
2023-06-28T11:26:31.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T11:26:31.803 INFO:teuthology.orchestra.console:Power off smithi177
2023-06-28T11:26:31.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T11:26:31.816 INFO:teuthology.orchestra.console:Power off smithi191
2023-06-28T11:26:31.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T11:26:31.826 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:31.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:31.842 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:31.953 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-06-28T11:26:31.954 INFO:teuthology.orchestra.console:Power off for smithi182 completed
2023-06-28T11:26:31.965 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2023-06-28T11:26:32.055 INFO:teuthology.orchestra.console:Power on smithi177
2023-06-28T11:26:32.056 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T11:26:32.066 INFO:teuthology.orchestra.console:Power on smithi182
2023-06-28T11:26:32.066 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T11:26:32.077 INFO:teuthology.orchestra.console:Power on smithi191
2023-06-28T11:26:32.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-28T11:26:37.085 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:37.096 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:37.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:42.100 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:42.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:42.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:42.311 INFO:teuthology.orchestra.console:Power on for smithi177 completed
2023-06-28T11:26:42.412 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish
2023-06-28T11:26:42.413 DEBUG:teuthology.provision.fog.smithi177:FOG request: GET /task/active None
2023-06-28T11:26:43.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:26:46.352 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-28T11:26:47.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:47.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:26:47.438 INFO:teuthology.orchestra.console:Power on for smithi191 completed
2023-06-28T11:26:47.539 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2023-06-28T11:26:47.539 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:26:52.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:27:00.624 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-28T11:27:01.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:27:06.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:27:11.633 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:27:12.614 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:27:17.622 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-28T11:27:17.723 INFO:teuthology.orchestra.console:Power on for smithi182 completed
2023-06-28T11:27:17.824 INFO:teuthology.provision.fog.smithi182:Waiting for deploy to finish
2023-06-28T11:27:17.825 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:27:23.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:27:31.696 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-28T11:27:32.688 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:27:37.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:27:42.702 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:27:45.776 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-28T11:27:51.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:27:57.712 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:27:58.646 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:28:10.096 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177
2023-06-28T11:28:13.524 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:28:18.530 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:28:18.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:28:28.628 ERROR:teuthology.orchestra.connection:Error authenticating with smithi177.front.sepia.ceph.com: Authentication failed.
2023-06-28T11:28:28.630 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T11:28:28.630 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T11:28:28.631 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:29.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:30.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:31.646 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:32.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:33.656 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:34.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:35.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:36.671 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:37.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:38.681 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:39.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:40.692 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:41.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:42.702 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:43.576 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:28:43.579 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:28:43.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:44.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:45.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:46.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:47.731 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:48.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:49.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:50.748 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:51.753 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:52.759 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:53.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:54.770 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:55.775 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:56.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:57.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:58.653 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:28:58.657 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:28:58.797 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:28:59.802 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:00.808 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:01.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:02.820 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:03.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:04.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:05.838 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:06.844 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:07.851 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:08.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:09.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:10.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:11.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:12.878 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:13.722 DEBUG:teuthology.provision.fog.smithi182:FOG request: GET /task/active None
2023-06-28T11:29:18.729 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:29:23.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-06-28T11:29:23.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:29:31.856 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-06-28T11:29:37.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:29:40.912 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-06-28T11:29:43.811 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None
2023-06-28T11:29:48.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:29:53.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:29:58.893 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-06-28T11:30:01.968 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T11:30:04.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:30:09.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:30:14.905 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-06-28T11:30:17.968 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-06-28T11:30:20.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:30:25.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:30:44.468 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-06-28T11:30:50.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:30:53.552 WARNING:teuthology.provision.fog.smithi182:[Errno None] Unable to connect to port 22 on 172.21.15.182
2023-06-28T11:30:59.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:30:59.882 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T11:30:59.882 DEBUG:teuthology.orchestra.run.smithi182:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T11:31:00.116 INFO:teuthology.provision.fog.smithi182:Node is ready
2023-06-28T11:31:00.116 DEBUG:teuthology.orchestra.run.smithi182:> hostname
2023-06-28T11:31:00.174 INFO:teuthology.orchestra.run.smithi182.stdout:smithi182.front.sepia.ceph.com
2023-06-28T11:31:00.175 DEBUG:teuthology.orchestra.run.smithi182:> grep smithi182.front.sepia.ceph.com /etc/hosts
2023-06-28T11:31:00.231 INFO:teuthology.orchestra.run.smithi182.stdout:172.21.15.182 smithi182.front.sepia.ceph.com smithi182
2023-06-28T11:31:00.232 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname smithi182
2023-06-28T11:31:00.361 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hosts
2023-06-28T11:31:00.391 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/172.21.15.182/172.21.15.182/g' /etc/hosts
2023-06-28T11:31:00.457 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i -e 's/smithi182.front.sepia.ceph.com/smithi182/g' /etc/hostname
2023-06-28T11:31:00.525 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname smithi182
2023-06-28T11:31:00.591 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release
2023-06-28T11:31:00.647 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="Red Hat Enterprise Linux"
2023-06-28T11:31:00.648 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8.6 (Ootpa)"
2023-06-28T11:31:00.648 INFO:teuthology.orchestra.run.smithi182.stdout:ID="rhel"
2023-06-28T11:31:00.648 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="fedora"
2023-06-28T11:31:00.648 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8.6"
2023-06-28T11:31:00.648 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8"
2023-06-28T11:31:00.648 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31"
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://www.redhat.com/"
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:
2023-06-28T11:31:00.649 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-28T11:31:00.650 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-28T11:31:00.650 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-28T11:31:00.650 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-28T11:31:00.651 INFO:teuthology.provision.fog.smithi182:Deploy complete!
2023-06-28T11:31:00.652 DEBUG:teuthology.parallel:result is None
2023-06-28T11:31:30.914 WARNING:teuthology.provision.fog.smithi191:timed out
2023-06-28T11:31:36.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-28T11:31:37.237 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-28T11:31:37.238 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-28T11:31:37.518 INFO:teuthology.provision.fog.smithi191:Node is ready
2023-06-28T11:31:37.518 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2023-06-28T11:31:37.537 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191
2023-06-28T11:31:37.537 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191 /etc/hosts
2023-06-28T11:31:37.595 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2023-06-28T11:31:37.595 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-06-28T11:31:37.724 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hosts
2023-06-28T11:31:37.753 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2023-06-28T11:31:37.820 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191/smithi191/g' /etc/hostname
2023-06-28T11:31:37.889 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-06-28T11:31:37.956 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-06-28T11:31:38.013 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Red Hat Enterprise Linux"
2023-06-28T11:31:38.013 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8.6 (Ootpa)"
2023-06-28T11:31:38.013 INFO:teuthology.orchestra.run.smithi191.stdout:ID="rhel"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="fedora"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8.6"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-06-28T11:31:38.014 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.redhat.com/"
2023-06-28T11:31:38.015 INFO:teuthology.orchestra.run.smithi191.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-06-28T11:31:38.015 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-28T11:31:38.015 INFO:teuthology.orchestra.run.smithi191.stdout:
2023-06-28T11:31:38.015 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-06-28T11:31:38.015 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-06-28T11:31:38.015 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-06-28T11:31:38.016 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-06-28T11:31:38.016 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2023-06-28T11:31:38.017 DEBUG:teuthology.parallel:result is None
2023-06-28T11:31:42.836 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-06-28T11:31:42.838 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
    x = self.__socket.recv(n)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv
    return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer
2023-06-28T11:31:42.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-28T11:31:42.839 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-28T11:31:47.922 INFO:teuthology.nuke:Checking targets against current locks
2023-06-28T11:31:59.284 DEBUG:teuthology.nuke:shortname: smithi177
2023-06-28T11:31:59.284 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T11:31:59.311 DEBUG:teuthology.nuke:shortname: smithi182
2023-06-28T11:31:59.311 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T11:31:59.314 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:58:43-fs-reef-release-distro-default-smithi/7319679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 11:25:11.551679', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLz7UAn8ShqbLuiH5jU6ulg6lq/J0ajavQH0yeSNfyl6xRFIKvg6IuLT0REROM+VknyuL6MRumX9rCQ3Vf+SmSQ='}
2023-06-28T11:31:59.323 DEBUG:teuthology.nuke:shortname: smithi191
2023-06-28T11:31:59.324 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-28T11:31:59.334 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:58:43-fs-reef-release-distro-default-smithi/7319679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 11:25:11.553030', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9bU++AVXXFvADpDGO70ezYoCckLxREMapF9FsZRZAYCcbWoU/AenZ4tteFSWnaYm0Ry15bxa5x845nPEW2n5GvY1x7FO/ZRjzaa5h0kUyBOjwpOgx+J3Ck82OLP3KRzX2ohr7qQiI16g4G87zlAxAhigMYwpz/7T057YqqenI6AU36WkDKeKH3aotYgcZVNSnt/5aPMS3C4hJiXE/ce+gv0xHIX69lNsnpeWE3EBpFNIYyB0IsQugzMt6FzWSApK5Ppwfr7gF3hlWU5gtV6lBbH5nhJTjqp+2cTySh14OBNSAp3ig5dfqzMLHV+auLgTNB9MwDYuDJDM94+Q4JQ/3dyRBcEQmF5m0UAB7r+0a/q2BQv6DwSZ5YmHFGaVTCM5tEC1VbROX7yDYfYu6qLtn1r/dLrS2xvyg6ZoB/hJ+ipIpL4tJNwj1E1EkXRjDeM5fXDdAcvo14E6w0OjQQwxXAOml09V6h4+UmcIj9fbDn55ZAEtaoGiiOjrHl8E3JzE='}
2023-06-28T11:31:59.350 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:58:43-fs-reef-release-distro-default-smithi/7319679', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 11:25:11.549955', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5pzarjqVLeKGa0R0sCQUyPfP3pKnc98HzGLBSAPbxkNWAFj1ONC+Madi9nGlDLcTQEfPcYTTIT9q++8nRDcdjzOWGGtiF9mDBwvoEQnOFw0Xnptqd75M8fF2KUoGNdejHCbsIAly9twwDmuoveCZu4FID+PMh+UPC6kHRa2ystSV3taPjwkLxPT2+5kxokHjfAHdMVOHHc1lzLdWOjDyR6VoJCSddhvG5AQjGsFx5t73a9aEsB0t6NfVBaq7CTehbvIWnMgITW0uHVpsKCjoHSOaEwIZfLtjcjMCXkKKd8nXgljmdcN0OdYivEjxke31WGr0ZwuPxmYf6fyXEsC3f1031cosYnxs4Es+SAGS2M8INJEH5mEyV5pNmKzRZ8tppqCHHdkIcKwIpVMDe9L9PdPimMH4M+C7EiksymFKd/zNj5Gwo2zdRJq9HO10g4TxFi0zeJ2JkG32M5Om0W+twHER2bWNK/yhK8nRnZtwZLvfTzLPQSY5pYiJ4RD8vhRU='}
2023-06-28T11:31:59.366 INFO:teuthology.orchestra.console:Power off smithi177
2023-06-28T11:31:59.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T11:31:59.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:31:59.413 INFO:teuthology.orchestra.console:Power off smithi191
2023-06-28T11:31:59.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T11:31:59.431 INFO:teuthology.orchestra.console:Power off smithi182
2023-06-28T11:31:59.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-28T11:31:59.444 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:31:59.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:03.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:03.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:03.485 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:08.561 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:08.585 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:08.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi182.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:08.806 INFO:teuthology.orchestra.console:Power off for smithi182 completed
2023-06-28T11:32:08.965 INFO:teuthology.lock.ops:unlocked: smithi182.front.sepia.ceph.com
2023-06-28T11:32:13.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:13.696 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:18.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:18.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:23.898 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:23.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:29.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:29.029 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:29.241 INFO:teuthology.orchestra.console:Power off for smithi191 completed
2023-06-28T11:32:29.404 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com
2023-06-28T11:32:34.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:39.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:44.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-28T11:32:44.563 INFO:teuthology.orchestra.console:Power off for smithi177 completed
2023-06-28T11:32:54.737 INFO:teuthology.lock.ops:unlocked: smithi177.front.sepia.ceph.com
2023-06-28T11:32:57.898 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run
    r.execute()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute
    self.client.exec_command(self.command, timeout=self.timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command
    chan = self._transport.open_session(timeout=timeout)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session
    return self.open_channel(
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel
    raise e
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run
    ptype, m = self.packetizer.read_message()
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message
    header = self.read_all(self.__block_size_in, check_rekey=True)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all
    x = self.__socket.recv(n)
  File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv
    return self._sock.recv(*args)
ConnectionResetError: [Errno 104] Connection reset by peer