2023-06-28T11:06:20.816 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T11:06:20.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T11:06:20.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T11:06:20.990 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fad6c395430>, signals=[15]) 2023-06-28T11:06:20.992 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-06-28T11:06:20.993 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T11:06:20.994 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-06-28T11:06:21.016 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-06-28T11:06:21.016 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T11:06:21.017 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-06-28T11:06:21.018 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /host {"name": "smithi088"} 2023-06-28T11:06:23.424 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-06-28T11:06:43.523 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T11:06:48.532 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-06-28T11:06:51.875 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T11:06:51.875 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 5} 2023-06-28T11:06:51.889 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5) 2023-06-28T11:06:51.889 DEBUG:teuthology.provision.fog.smithi088:FOG request: PUT /host/193 {"imageID": 5} 2023-06-28T11:06:51.946 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2023-06-28T11:06:51.946 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-06-28T11:06:51.959 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6 2023-06-28T11:06:51.960 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-28T11:06:52.061 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T11:06:52.065 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T11:06:52.107 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-06-28T11:06:52.110 DEBUG:teuthology.provision.fog.smithi088:FOG request: POST /host/193/task {"taskTypeID": 1} 2023-06-28T11:06:52.187 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-06-28T11:06:57.195 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-28T11:07:02.331 INFO:teuthology.orchestra.console:Power off smithi088 2023-06-28T11:07:02.332 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:07:02.345 INFO:teuthology.orchestra.console:Power off smithi102 2023-06-28T11:07:02.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:07:02.355 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:02.367 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:02.477 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-06-28T11:07:02.578 INFO:teuthology.orchestra.console:Power on smithi088 2023-06-28T11:07:02.578 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T11:07:02.599 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:06.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:06.621 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:10.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:10.733 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:15.619 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:15.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:20.730 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:20.943 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-06-28T11:07:20.954 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:21.044 INFO:teuthology.orchestra.console:Power on smithi102 2023-06-28T11:07:21.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T11:07:21.067 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:21.165 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2023-06-28T11:07:21.266 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-06-28T11:07:21.266 DEBUG:teuthology.provision.fog.smithi088:FOG request: GET /task/active None 2023-06-28T11:07:24.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:07:25.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:07:25.302 INFO:teuthology.orchestra.console:Power on for smithi102 completed 2023-06-28T11:07:25.403 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-06-28T11:07:25.404 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-06-28T11:07:30.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:07:42.836 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-28T11:07:48.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:07:53.845 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-06-28T11:07:56.912 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-28T11:07:59.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:02.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:07.921 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-06-28T11:08:10.992 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-28T11:08:13.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:16.976 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-06-28T11:08:16.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:20.048 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-28T11:08:22.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:26.032 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-06-28T11:08:26.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:32.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:49.392 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-28T11:08:55.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:08:55.536 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-06-28T11:08:58.448 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-06-28T11:09:01.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:09:01.855 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-06-28T11:09:04.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:09:04.572 ERROR:teuthology.orchestra.connection:Error authenticating with smithi088.front.sepia.ceph.com: Authentication failed. 2023-06-28T11:09:04.573 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T11:09:04.574 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T11:09:04.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:05.581 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:06.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:07.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:07.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:09:07.932 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: Authentication failed. 2023-06-28T11:09:07.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T11:09:07.933 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T11:09:07.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:08.599 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:08.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:09.608 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:09.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:10.616 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:10.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:11.625 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:11.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:12.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:12.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:13.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:13.984 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:14.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:14.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:15.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:16.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:16.666 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:17.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:17.675 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:18.019 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:18.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:19.029 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:19.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:20.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:20.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:21.048 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:21.717 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:22.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:22.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:23.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:23.736 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:24.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:24.745 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:25.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:25.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:26.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:26.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:27.106 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:27.775 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:28.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:28.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:29.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:29.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:30.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:30.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:31.145 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:31.815 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:32.155 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:32.826 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:33.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:33.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:34.171 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:34.843 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:35.180 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:35.852 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:36.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:36.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:37.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:37.872 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:38.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:38.882 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:39.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:39.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:40.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:40.900 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:41.235 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:41.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:42.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:42.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:43.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:43.932 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:44.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:44.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:45.273 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:45.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:46.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:46.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:47.292 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:47.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:48.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:48.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:49.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:49.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:50.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:50.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:51.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:52.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:52.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:53.013 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:53.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:54.022 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:54.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:55.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:55.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:56.039 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:56.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:57.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:57.382 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:58.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:58.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:59.067 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:09:59.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:00.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:00.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:01.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:01.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:02.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:02.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:03.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:03.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:04.115 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:04.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:05.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:05.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:06.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:06.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:07.142 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:07.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:08.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:08.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:09.160 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:09.496 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:10.169 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:10.506 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:11.178 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:11.516 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:12.187 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:12.526 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:13.197 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:13.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:14.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:14.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:15.218 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:15.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:16.228 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:16.567 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:17.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:17.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:18.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:18.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:19.257 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:19.596 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:20.266 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:20.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:21.276 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:21.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:22.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:22.626 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:23.297 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:23.635 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:24.306 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:24.645 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:25.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:25.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:26.325 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:26.664 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:27.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:27.674 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:28.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:28.685 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:29.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:29.693 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:30.362 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:30.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:31.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:31.713 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:32.381 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:32.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:33.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:33.732 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:34.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:34.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:35.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:35.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:36.415 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:36.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:37.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:37.767 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:38.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:38.776 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:39.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:39.786 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:40.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:40.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:41.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:41.805 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:42.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:42.813 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:43.481 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:43.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:44.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:44.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:45.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:45.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:46.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:46.850 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:47.524 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:47.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:48.536 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:48.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:49.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:49.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:50.556 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:50.889 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:51.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:51.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:52.575 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:52.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:53.583 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:53.915 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:54.593 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:54.925 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:55.602 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:55.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:56.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:56.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:57.620 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:57.954 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:58.630 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:58.964 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:10:59.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:11:00.983 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:11:01.994 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:13:12.817 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-06-28T11:13:12.822 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer 2023-06-28T11:13:12.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T11:13:12.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T11:13:17.836 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-06-28T11:13:17.914 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T11:13:32.392 DEBUG:teuthology.nuke:shortname: smithi088 2023-06-28T11:13:32.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T11:13:42.428 DEBUG:teuthology.nuke:shortname: smithi102 2023-06-28T11:13:42.429 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T11:13:47.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:58:43-fs-reef-release-distro-default-smithi/7319626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 11:06:19.974172', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH2IKxMlsmwMqsCAtDjOl49dPk6L7Kw0pWLhTbKH5jWTQgMPq0E/Tb4I4ktGL9pOhV0OAsn4vXBMgeeVQCDdD9Q='} 2023-06-28T11:13:57.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:58:43-fs-reef-release-distro-default-smithi/7319626', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 11:06:19.972846', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMLvGrAElEQqFuCFTwUmm1faSSIFdn6UFygt488j/ftyqVWed1VIn1aknRsgS1aVY2l+fhbCeRWNcbVuNpv6vkCh80VTneTevV2v+MjMoe3LJs7a/68glc/Blvt+SpbWZ1usolx9kzgNhOa2BuAhv3NW5CJQgDQJoyU/d81sea7l+QHHNndc6xyHdG3RdoRyQxoXRjE2WUllbPY9neiKmBQBuPBdioivkq2iGAyyRXH63UZveH92tALbVoNp/mtE9RtYor3FRAvyJd+j5Erzw8Oys73OLyOL5dPkC9Sda52Bv2efb008yrcZyPyJ51xSu6pmyVUHN5ZUT/cm5zXcn0Fg943chV5+TCH35dMtlYbBih8NVhQXhnhcJpQ3tuXxP/wz6wq1fiMOEcp3vks00dskgXJVD4GfYcDi3iRhPjaNuJ4Ujc2KzLLNUFTQ1c+6K6qrWbrBqSa/c4lUafoQLYS7HMWLB6ela+1I/Kt8qBIUquh9O2sgTG/b3BddF7UT0='} 2023-06-28T11:13:57.842 INFO:teuthology.orchestra.console:Power off smithi088 2023-06-28T11:13:57.843 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:13:57.862 INFO:teuthology.orchestra.console:Power off smithi102 2023-06-28T11:13:57.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:13:57.874 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:13:57.891 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:01.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:01.917 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:07.022 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:07.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:12.135 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:12.145 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:12.355 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-06-28T11:14:16.295 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-06-28T11:14:20.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:25.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:30.476 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:35.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:40.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:45.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:50.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:14:56.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:15:01.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:15:06.261 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:15:11.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:15:11.584 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-06-28T11:15:21.748 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-06-28T11:15:32.034 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer