2023-07-17T11:35:57.934 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-17T11:35:57.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:35:57.935 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:36:18.123 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f82326c3580>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8232057940>, signals=[15])
2023-07-17T11:36:18.125 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2023-07-17T11:36:18.125 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2023-07-17T11:36:18.125 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-07-17T11:36:23.158 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-07-17T11:36:23.159 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-07-17T11:36:23.159 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-07-17T11:36:23.160 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"}
2023-07-17T11:36:28.192 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-07-17T11:36:32.712 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-17T11:36:42.718 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-17T11:36:47.766 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_8.stream (ID 3)
2023-07-17T11:36:47.766 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 3}
2023-07-17T11:36:52.774 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_8.stream (ID 3)
2023-07-17T11:36:52.774 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 3}
2023-07-17T11:36:55.829 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.stream
2023-07-17T11:36:55.829 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-17T11:37:00.635 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2023-07-17T11:37:00.635 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-07-17T11:37:00.708 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"}
2023-07-17T11:37:05.715 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-07-17T11:37:10.758 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1}
2023-07-17T11:37:15.765 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-07-17T11:37:20.818 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-07-17T11:37:25.749 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-17T11:37:25.886 INFO:teuthology.orchestra.console:Power off smithi027
2023-07-17T11:37:25.888 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T11:37:25.908 INFO:teuthology.orchestra.console:Power off smithi079
2023-07-17T11:37:25.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T11:37:25.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:25.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:26.043 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2023-07-17T11:37:26.054 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2023-07-17T11:37:26.145 INFO:teuthology.orchestra.console:Power on smithi027
2023-07-17T11:37:26.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-17T11:37:26.155 INFO:teuthology.orchestra.console:Power on smithi079
2023-07-17T11:37:26.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-17T11:37:26.167 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:26.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:30.196 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:30.207 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:34.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:35.311 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:39.432 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:39.642 INFO:teuthology.orchestra.console:Power on for smithi079 completed
2023-07-17T11:37:39.743 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-07-17T11:37:39.745 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-07-17T11:37:44.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:44.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:37:47.924 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-17T11:37:49.866 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:37:50.672 INFO:teuthology.orchestra.console:Power on for smithi027 completed
2023-07-17T11:37:50.773 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2023-07-17T11:37:50.773 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-07-17T11:37:50.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:37:53.908 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:37:53.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:37:59.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:04.917 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-17T11:38:07.984 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:38:10.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:15.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:18.992 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:38:18.993 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-17T11:38:24.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:30.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:35.005 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:38:38.064 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-17T11:38:41.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:46.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:38:51.014 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:38:57.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:39:05.104 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:39:08.411 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-07-17T11:39:11.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:39:16.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:39:21.116 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:39:21.185 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: Authentication failed.
2023-07-17T11:39:21.187 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-17T11:39:21.188 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-17T11:39:21.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:22.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:23.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:24.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:25.210 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:26.220 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:27.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:39:27.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:28.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:29.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:30.192 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:39:30.252 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:31.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:32.267 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:33.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:34.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:35.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:36.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:39:41.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:41.314 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: Authentication failed.
2023-07-17T11:39:41.314 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-17T11:39:41.315 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-17T11:39:41.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:42.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:42.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:43.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:43.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:44.230 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:44.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:45.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:45.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:46.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:46.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:47.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:47.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:48.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:48.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:49.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:49.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:50.286 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:50.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:51.287 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:51.488 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:52.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:52.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:53.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:53.505 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:54.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:54.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:55.323 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:55.525 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:56.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:56.533 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:57.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:57.545 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:58.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:58.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:59.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:39:59.565 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:00.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:00.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:01.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:01.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:02.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:02.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:03.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:03.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:04.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:04.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:05.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:05.645 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:06.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:06.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:07.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:07.663 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:08.458 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:08.671 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:09.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:10.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:11.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:12.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:13.729 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:14.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:15.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:16.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:17.764 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:18.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:19.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:20.793 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:21.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:22.815 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:23.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:24.839 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:25.849 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:26.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:27.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:28.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:29.888 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:30.896 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:31.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:32.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:33.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:34.932 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:35.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:36.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:37.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:38.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:39.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:40.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:41.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:43.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:44.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:45.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:46.034 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:47.043 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:48.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:49.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:50.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:51.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:52.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:53.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:54.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:55.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:56.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:57.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:58.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:40:59.152 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:00.159 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:01.166 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:02.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:03.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:04.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:05.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:06.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:07.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:08.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:09.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:10.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:11.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:12.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:13.271 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:14.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:15.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:16.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:17.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:18.313 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:19.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:20.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:21.342 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:22.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:23.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:24.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:25.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:26.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:27.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:28.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:29.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:30.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:31.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:32.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:33.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:34.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:35.463 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:36.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:37.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:38.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:39.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:40.509 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-17T11:41:41.206 ERROR:teuthology.provision.fog: on smithi027
2023-07-17T11:41:50.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-07-17T11:41:50.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:41:56.212 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-17T11:41:56.213 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi079
2023-07-17T11:42:05.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-07-17T11:42:05.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:42:05.418 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-07-17T11:42:05.662 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-07-17T11:42:05.663 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-17T11:42:05.663 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-17T11:42:10.684 INFO:teuthology.provision.fog.smithi079:Node is ready
2023-07-17T11:42:10.684 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2023-07-17T11:42:10.707 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2023-07-17T11:42:10.708 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2023-07-17T11:42:10.769 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2023-07-17T11:42:10.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-07-17T11:42:10.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2023-07-17T11:42:10.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2023-07-17T11:42:10.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2023-07-17T11:42:11.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-07-17T11:42:11.131 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-07-17T11:42:11.190 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2023-07-17T11:42:11.190 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8"
2023-07-17T11:42:11.190 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2023-07-17T11:42:11.190 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2023-07-17T11:42:11.190 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8"
2023-07-17T11:42:11.190 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-17T11:42:11.191 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-17T11:42:11.192 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2023-07-17T11:42:11.194 DEBUG:teuthology.parallel:result is None
2023-07-17T11:42:29.744 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:42:38.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-07-17T11:42:38.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:42:46.833 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:42:58.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-07-17T11:42:58.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:43:06.896 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:43:09.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-07-17T11:43:09.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-17T11:43:49.360 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-07-17T11:43:49.361 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds
2023-07-17T11:43:49.362 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines...
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi027
2023-07-17T11:43:49.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-17T11:43:49.364 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-17T11:43:54.446 INFO:teuthology.nuke:Checking targets against current locks
2023-07-17T11:43:59.510 DEBUG:teuthology.nuke:shortname: smithi027
2023-07-17T11:43:59.510 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-17T11:43:59.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341326', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-17 11:36:17.620704', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}
2023-07-17T11:43:59.541 DEBUG:teuthology.nuke:shortname: smithi079
2023-07-17T11:43:59.541 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-17T11:43:59.565 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/akupczyk-2023-07-17_10:29:23-rados-wip-aclamk-pere-log-runway-distro-default-smithi/7341325', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-17 11:35:42.126722', 'locked_by': 'scheduled_akupczyk@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDftxiChZoPK9hcOaYpWh/8J+OedLVQ95H34RhmsNo3D'}
2023-07-17T11:43:59.591 INFO:teuthology.orchestra.console:Power off smithi027
2023-07-17T11:43:59.592 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T11:43:59.613 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:43:59.635 INFO:teuthology.orchestra.console:Power off smithi079
2023-07-17T11:43:59.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-17T11:43:59.662 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:03.652 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:03.686 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:08.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:08.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:13.881 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:13.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:18.994 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:19.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:24.108 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:24.134 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:29.221 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:29.244 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:34.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:34.356 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:34.569 INFO:teuthology.orchestra.console:Power off for smithi079 completed
2023-07-17T11:44:34.732 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com
2023-07-17T11:44:39.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-17T11:44:39.661 INFO:teuthology.orchestra.console:Power off for smithi027 completed
2023-07-17T11:44:49.830 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2023-07-17T11:45:00.092 CRITICAL:teuthology:Uncaught exception
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in <module>
    sys.exit(main())
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main
    sys.exit(teuthology.dispatcher.main(args))
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main
    return supervisor.main(args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main
    reimage(job_config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage
    reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type'])
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines
    reimaged[machine] = machines[machine]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage
    result = obj.create()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create
    self._wait_for_ready()
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready
    self.remote.run(args=cmd, timeout=600)
  File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 521, in run
    raise Exception(f'Cannot connect to remote host {self.shortname}')
Exception: Cannot connect to remote host smithi027