2023-07-15T18:44:18.279 INFO:root:teuthology version: 0.0.1.dev147+gff9991b 2023-07-15T18:44:18.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T18:44:18.282 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T18:44:38.119 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2a4f66c8b0>, signals=[15]) 2023-07-15T18:44:38.121 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2023-07-15T18:44:38.121 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T18:44:38.121 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-07-15T18:44:38.144 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2023-07-15T18:44:38.145 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T18:44:38.145 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-07-15T18:44:38.146 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /host {"name": "smithi073"} 2023-07-15T18:44:48.178 INFO:teuthology.lock.ops:Start node 'smithi139.front.sepia.ceph.com' reimaging 2023-07-15T18:44:48.178 INFO:teuthology.lock.ops:Updating [smithi139.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T18:44:48.178 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2023-07-15T18:44:48.179 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /host {"name": "smithi078"} 2023-07-15T18:45:08.194 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-07-15T18:45:08.194 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-07-15T18:45:08.194 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-07-15T18:45:08.196 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /host {"name": "smithi139"} 2023-07-15T18:45:21.292 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-15T18:45:21.294 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /host {"name": "smithi140"} 2023-07-15T18:45:36.314 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-15T18:45:36.315 DEBUG:teuthology.provision.fog.smithi073:FOG request: PUT /host/178 {"imageID": 5} 2023-07-15T18:45:36.316 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-15T18:45:44.946 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.6 2023-07-15T18:45:44.947 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-15T18:45:44.948 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-15T18:45:54.962 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-15T18:45:54.962 DEBUG:teuthology.provision.fog.smithi078:FOG request: PUT /host/183 {"imageID": 5} 2023-07-15T18:45:54.986 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-07-15T18:45:55.018 DEBUG:teuthology.provision.fog.smithi139:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-15T18:45:55.019 DEBUG:teuthology.provision.fog.smithi139:FOG request: PUT /host/244 {"imageID": 5} 2023-07-15T18:45:55.021 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of rhel 8.6 2023-07-15T18:45:55.021 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-15T18:45:55.032 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.6 (ID 5) 2023-07-15T18:45:55.032 DEBUG:teuthology.provision.fog.smithi140:FOG request: PUT /host/245 {"imageID": 5} 2023-07-15T18:45:55.044 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T18:45:55.076 INFO:teuthology.provision.fog.smithi139:Scheduling deploy of rhel 8.6 2023-07-15T18:45:55.076 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T18:45:55.086 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.6 2023-07-15T18:45:55.086 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-15T18:45:55.088 DEBUG:teuthology.provision.fog.smithi073:FOG request: POST /host/178/task {"taskTypeID": 1} 2023-07-15T18:45:55.107 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T18:46:00.118 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T18:46:00.120 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /tasktype {"name": "deploy"} 2023-07-15T18:46:00.121 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-15T18:46:10.181 DEBUG:teuthology.provision.fog.smithi140:FOG request: POST /host/245/task {"taskTypeID": 1} 2023-07-15T18:46:10.185 DEBUG:teuthology.provision.fog.smithi078:FOG request: POST /host/183/task {"taskTypeID": 1} 2023-07-15T18:46:10.190 DEBUG:teuthology.provision.fog.smithi139:FOG request: POST /host/244/task {"taskTypeID": 1} 2023-07-15T18:46:15.236 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-15T18:46:15.238 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T18:46:15.239 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-15T18:46:25.280 INFO:teuthology.orchestra.console:Power off smithi073 2023-07-15T18:46:25.282 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:46:25.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:30.354 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:40.258 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-15T18:46:40.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:46:40.273 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-15T18:46:40.274 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:46:40.293 INFO:teuthology.orchestra.console:Power off smithi078 2023-07-15T18:46:40.294 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:46:40.303 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:40.312 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:40.324 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:40.333 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-07-15T18:46:40.435 INFO:teuthology.orchestra.console:Power on smithi073 2023-07-15T18:46:40.435 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T18:46:44.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:44.349 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:44.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:45.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:48.463 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:48.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:48.676 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-15T18:46:48.777 INFO:teuthology.orchestra.console:Power on smithi139 2023-07-15T18:46:48.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T18:46:49.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:50.475 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:52.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:52.797 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-07-15T18:46:52.899 INFO:teuthology.orchestra.console:Power on smithi078 2023-07-15T18:46:52.899 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T18:46:52.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:54.568 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:55.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:56.945 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:46:59.680 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:00.699 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:02.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:03.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:04.794 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:05.811 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:07.171 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:08.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:09.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:10.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:12.282 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:13.935 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:15.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:16.036 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:17.397 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:19.052 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:20.132 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:21.149 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:21.362 INFO:teuthology.orchestra.console:Power on for smithi073 completed 2023-07-15T18:47:21.463 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2023-07-15T18:47:21.463 DEBUG:teuthology.provision.fog.smithi073:FOG request: GET /task/active None 2023-07-15T18:47:26.473 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:26.483 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:26.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:26.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:47:31.719 INFO:teuthology.orchestra.console:Power on for smithi078 completed 2023-07-15T18:47:31.719 INFO:teuthology.orchestra.console:Power on for smithi139 completed 2023-07-15T18:47:31.719 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-15T18:47:31.820 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2023-07-15T18:47:31.820 DEBUG:teuthology.provision.fog.smithi078:FOG request: GET /task/active None 2023-07-15T18:47:31.822 INFO:teuthology.provision.fog.smithi139:Waiting for deploy to finish 2023-07-15T18:47:31.822 DEBUG:teuthology.provision.fog.smithi139:FOG request: GET /task/active None 2023-07-15T18:47:31.823 INFO:teuthology.orchestra.console:Power on smithi140 2023-07-15T18:47:31.823 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-15T18:47:39.307 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-07-15T18:47:39.309 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:39.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:47:39.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:47:42.480 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T18:47:42.481 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-15T18:47:44.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:47:45.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:47:50.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:47:55.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:00.324 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T18:48:00.325 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-07-15T18:48:00.426 INFO:teuthology.orchestra.console:Power on for smithi140 completed 2023-07-15T18:48:00.527 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-07-15T18:48:00.527 DEBUG:teuthology.provision.fog.smithi140:FOG request: GET /task/active None 2023-07-15T18:48:05.541 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-15T18:48:05.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:10.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:15.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:15.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:20.665 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-15T18:48:26.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:29.744 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-15T18:48:31.203 ERROR:teuthology.orchestra.connection:Error authenticating with smithi073.front.sepia.ceph.com: Authentication failed. 2023-07-15T18:48:31.205 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:48:31.206 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:48:31.207 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:32.212 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:33.219 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:34.164 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T18:48:34.226 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:35.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:35.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:36.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:36.678 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-07-15T18:48:37.246 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:38.254 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:38.800 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-15T18:48:39.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:40.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:40.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:41.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:42.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:42.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:42.799 ERROR:teuthology.orchestra.connection:Error authenticating with smithi078.front.sepia.ceph.com: Authentication failed. 2023-07-15T18:48:42.799 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:48:42.799 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:48:42.800 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:43.248 WARNING:teuthology.provision.fog.smithi139:[Errno None] Unable to connect to port 22 on 172.21.15.139 2023-07-15T18:48:43.293 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:43.811 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:44.302 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:44.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:44.819 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:45.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:45.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:46.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:46.845 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:47.331 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:47.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:47.857 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-15T18:48:48.344 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:48.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:49.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:54.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:48:59.258 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:59.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:48:59.330 ERROR:teuthology.orchestra.connection:Error authenticating with smithi139.front.sepia.ceph.com: Authentication failed. 2023-07-15T18:48:59.331 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:48:59.331 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:48:59.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:00.269 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:00.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:00.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:01.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:01.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:01.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:02.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:02.296 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:02.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:03.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:03.307 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:03.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:04.316 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:04.317 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:04.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:05.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:05.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:05.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:06.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:06.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:06.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:07.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:07.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:07.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:08.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:08.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:08.430 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:09.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:09.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:09.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:10.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:10.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:10.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:11.387 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:11.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:11.461 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:12.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:12.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:12.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:13.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:13.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:13.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:14.422 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:14.423 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:14.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:15.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:15.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:15.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:16.442 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:16.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:16.519 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:17.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:17.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:17.531 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:17.680 WARNING:teuthology.provision.fog.smithi140:[Errno None] Unable to connect to port 22 on 172.21.15.140 2023-07-15T18:49:18.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:18.468 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:18.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:19.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:19.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:19.549 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:20.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:20.489 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:20.560 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:21.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:21.503 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:21.570 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:22.512 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:22.513 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:22.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:23.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:23.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:23.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:23.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:49:28.688 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:28.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:28.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:28.763 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: Authentication failed. 2023-07-15T18:49:28.764 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:49:28.764 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:49:28.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:29.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:29.700 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:29.701 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:29.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:30.706 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:30.708 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:30.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:30.783 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:31.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:31.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:31.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:31.791 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:32.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:32.725 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:32.725 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:32.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:33.732 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:33.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:33.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:34.740 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:34.743 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:34.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:35.749 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:35.750 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:35.835 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:36.758 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:36.759 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:36.846 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:37.768 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:37.858 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:38.777 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:38.870 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:39.787 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:39.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:40.798 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:40.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:41.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:41.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:42.816 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:42.909 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:43.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:43.919 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:44.832 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:44.929 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:45.841 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:45.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:46.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:46.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:47.865 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:47.958 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:48.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:49.976 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:50.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:51.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:53.001 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:54.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:55.023 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:56.032 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:57.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:58.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:49:59.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:00.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:01.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:02.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:03.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:04.112 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:05.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:06.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:07.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:08.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:09.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:10.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:11.189 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:12.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:13.206 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:14.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:15.225 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:16.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:17.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:18.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:19.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:20.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:21.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:22.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:23.301 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:24.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:25.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:26.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:27.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:50:28.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-15T18:51:20.048 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-15T18:51:20.050 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi073 2023-07-15T18:51:24.147 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-15T18:51:24.148 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi078 2023-07-15T18:51:29.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-15T18:51:29.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:51:34.057 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-07-15T18:51:34.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:51:39.064 ERROR:teuthology.provision.fog: on smithi139 2023-07-15T18:51:39.286 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-07-15T18:51:39.410 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-07-15T18:51:39.639 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-07-15T18:51:39.640 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:51:39.640 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:51:39.659 INFO:teuthology.provision.fog.smithi073:Node is ready 2023-07-15T18:51:39.660 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2023-07-15T18:51:39.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-07-15T18:51:39.707 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:51:39.708 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:51:39.718 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2023-07-15T18:51:39.719 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2023-07-15T18:51:39.728 INFO:teuthology.provision.fog.smithi078:Node is ready 2023-07-15T18:51:39.728 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2023-07-15T18:51:39.778 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2023-07-15T18:51:39.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-07-15T18:51:39.786 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2023-07-15T18:51:39.786 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2023-07-15T18:51:39.843 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2023-07-15T18:51:39.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-07-15T18:51:39.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2023-07-15T18:51:39.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2023-07-15T18:51:39.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2023-07-15T18:51:39.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2023-07-15T18:51:40.003 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2023-07-15T18:51:40.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2023-07-15T18:51:40.072 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2023-07-15T18:51:40.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2023-07-15T18:51:40.140 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-07-15T18:51:40.183 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-07-15T18:51:40.196 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux" 2023-07-15T18:51:40.196 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.6 (Ootpa)" 2023-07-15T18:51:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel" 2023-07-15T18:51:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora" 2023-07-15T18:51:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.6" 2023-07-15T18:51:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-07-15T18:51:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-15T18:51:40.197 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/" 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T18:51:40.198 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-15T18:51:40.199 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-15T18:51:40.199 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-15T18:51:40.200 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2023-07-15T18:51:40.201 DEBUG:teuthology.parallel:result is None 2023-07-15T18:51:40.241 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Red Hat Enterprise Linux" 2023-07-15T18:51:40.241 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="8.6 (Ootpa)" 2023-07-15T18:51:40.241 INFO:teuthology.orchestra.run.smithi078.stdout:ID="rhel" 2023-07-15T18:51:40.241 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="fedora" 2023-07-15T18:51:40.241 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="8.6" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el8" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.redhat.com/" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-15T18:51:40.242 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T18:51:40.243 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-07-15T18:51:40.243 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T18:51:40.243 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-15T18:51:40.243 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-15T18:51:40.243 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-15T18:51:40.244 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2023-07-15T18:51:40.244 DEBUG:teuthology.parallel:result is None 2023-07-15T18:51:48.065 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-15T18:51:48.066 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-15T18:51:48.419 DEBUG:teuthology.orchestra.run.smithi139:> true 2023-07-15T18:51:48.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2023-07-15T18:51:48.706 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-15T18:51:48.706 DEBUG:teuthology.orchestra.run.smithi139:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-15T18:51:48.723 INFO:teuthology.provision.fog.smithi139:Node is ready 2023-07-15T18:51:48.723 DEBUG:teuthology.orchestra.run.smithi139:> hostname 2023-07-15T18:51:48.781 INFO:teuthology.orchestra.run.smithi139.stdout:smithi139.front.sepia.ceph.com 2023-07-15T18:51:48.782 DEBUG:teuthology.orchestra.run.smithi139:> grep smithi139.front.sepia.ceph.com /etc/hosts 2023-07-15T18:51:48.840 INFO:teuthology.orchestra.run.smithi139.stdout:172.21.15.139 smithi139.front.sepia.ceph.com smithi139 2023-07-15T18:51:48.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-15T18:51:48.960 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hosts 2023-07-15T18:51:48.989 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/172.21.15.139/172.21.15.139/g' /etc/hosts 2023-07-15T18:51:49.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i -e 's/smithi139.front.sepia.ceph.com/smithi139/g' /etc/hostname 2023-07-15T18:51:49.123 DEBUG:teuthology.orchestra.run.smithi139:> sudo hostname smithi139 2023-07-15T18:51:49.190 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2023-07-15T18:51:49.247 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Red Hat Enterprise Linux" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="8.6 (Ootpa)" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:ID="rhel" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="fedora" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="8.6" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el8" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-15T18:51:49.248 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.redhat.com/" 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout: 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-15T18:51:49.249 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-15T18:51:49.250 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-15T18:51:49.250 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-15T18:51:49.250 INFO:teuthology.provision.fog.smithi139:Deploy complete! 2023-07-15T18:51:49.251 DEBUG:teuthology.parallel:result is None 2023-07-15T18:59:28.852 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel. 2023-07-15T18:59:28.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-15T18:59:28.855 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-15T18:59:33.951 INFO:teuthology.nuke:Checking targets against current locks 2023-07-15T18:59:51.284 DEBUG:teuthology.nuke:shortname: smithi073 2023-07-15T18:59:51.284 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T18:59:51.320 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:06-powercycle-reef-distro-default-smithi/7339314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 18:43:56.675864', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVqWZdWg3v4AONjZd7Aul0QAvGhJh0BbAd0tuPNET4NlwzfcD32DHHQGtukCWLgHEvk2lA6si1rDzMmjIdoC3U='} 2023-07-15T18:59:51.323 DEBUG:teuthology.nuke:shortname: smithi078 2023-07-15T18:59:51.323 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T18:59:51.352 DEBUG:teuthology.nuke:shortname: smithi139 2023-07-15T18:59:51.352 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T18:59:51.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:06-powercycle-reef-distro-default-smithi/7339314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 18:43:56.677249', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-15T18:59:51.362 DEBUG:teuthology.nuke:shortname: smithi140 2023-07-15T18:59:51.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-15T18:59:51.382 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:06-powercycle-reef-distro-default-smithi/7339314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 18:43:56.674443', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClMI9HfFskJUMoJPwDgh0uEZ2dMPzSpSOadWLQjSU/7pU0Oxz/hwUQ8+Mz5pW9R0a3AcE2wIaopraZ0WfXW8OTfnMem8rr7i7vvD005wx4STiIAJdpu9mC4orfc/OruOlsNMHwVLYojsiGK7w8Yf5DWi6UPu9ESoF5h4EF8ajjxEp+TKhzlhoZlG/esWCFlrYCBzzs6I6N+VdS0xl5Gzlj3JQwQR/Yg26mrnQMFgN11lBJKBoaA3gDxsXJz3lS6cu3/dcAjJvX8yRDSlZy/PEcov514pDGqPEVUDWavCEZKhWaQ0jr4rEz428ELM6D+C4K6SVmbZ7UKZ06LETz82bvEyxrskr/9v8HwmXGtN7gtkgGEXqk/Lw2/ZsBy/ohvM2Cic7tB9ic4Tw/1eDFz9Jh71OulNz0Gy2VZnudZIMtDI18nP2vmo2j4Fz9nNZsVZpt2f2y25PoQPBcMIqEQ4dDnOk6mTFEFTmwI9jwam5FZUxvzVWrNrwLoEC+6719XCc='} 2023-07-15T18:59:51.395 INFO:teuthology.orchestra.console:Power off smithi073 2023-07-15T18:59:51.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:59:51.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-14_23:49:06-powercycle-reef-distro-default-smithi/7339314', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-15 18:43:56.672632', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuwj6GePb54XtvHgG1s9FxWrlJFeTKVyPcVyT1ium23DeCzchJYgSO1YYpTWAMYShmk6kRu+FEHs76Lbnb3/acbsGt1WI+4Zw6K94rE3UkjZEFcf1nKgOxvk1zNLIHBc0IYtQpucqcYjwh1Gk6yZ1Sf/u2A9TuftD1FudYwC8h+Pr0e6VGtU/8FGJXnVWRxZpwrYN81ziqhZxAcUPYSo6eGy32tR++KC0lBcd/ox1a5lH0GA0B14G+AqbgLXFMpU/ZEEFMFM1ljM5eyJNJauJLUeMf3uwoqAHdSz3+eEI/cHu4GydM0yhv4mQtyfxP8d75yLdLGgeWO321PDFNkMuGQu/cQgKVR/zVFPM8SCIGdxFV3HoJOJKs/iWSrPXre+rSrElm2ixgUw6cVj2l8euyytm+fayHkGAl4A1THJd9y8dSRwBW/MCZZeYpfP8HP6m3B/fQMZ5wUxRzDn7FSf93LVA0sK6FhIbsyllH8RV3joHnS6dN5EAPsTuGr+KI0/k='} 2023-07-15T18:59:51.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:51.441 INFO:teuthology.orchestra.console:Power off smithi078 2023-07-15T18:59:51.442 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:59:51.469 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:51.492 INFO:teuthology.orchestra.console:Power off smithi140 2023-07-15T18:59:51.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:59:51.518 INFO:teuthology.orchestra.console:Power off smithi139 2023-07-15T18:59:51.519 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-15T18:59:51.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:51.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:55.460 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:55.532 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:55.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T18:59:55.574 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:00:00.585 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:00:00.646 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:00:00.677 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:00:00.689 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-15T19:00:00.903 INFO:teuthology.orchestra.console:Power off for smithi139 completed 2023-07-15T19:00:06.061 INFO:teuthology.lock.ops:unlocked: smithi139.front.sepia.ceph.com 2023-07-15T19:00:06.115 INFO:teuthology.orchestra.console:Power off for smithi073 completed 2023-07-15T19:00:06.116 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-07-15T19:00:06.116 INFO:teuthology.orchestra.console:Power off for smithi140 completed 2023-07-15T19:00:06.287 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com 2023-07-15T19:00:06.296 INFO:teuthology.lock.ops:unlocked: smithi078.front.sepia.ceph.com 2023-07-15T19:00:06.297 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com 2023-07-15T19:00:06.813 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1054, in open_channel raise SSHException("Timeout opening channel.") paramiko.ssh_exception.SSHException: Timeout opening channel.