2023-06-28T18:15:50.394 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T18:15:50.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:15:50.396 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:16:15.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b043f64c0>, signals=[15]) 2023-06-28T18:16:15.617 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-06-28T18:16:15.618 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:16:15.618 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-06-28T18:16:20.651 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-06-28T18:16:20.652 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:16:20.652 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-06-28T18:16:20.654 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-06-28T18:16:30.683 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-06-28T18:16:30.683 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T18:16:30.684 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-06-28T18:16:30.685 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /host {"name": "smithi118"} 2023-06-28T18:16:45.703 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-06-28T18:16:55.719 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-28T18:17:05.733 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-28T18:17:10.742 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-28T18:17:10.742 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 6} 2023-06-28T18:17:15.750 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-06-28T18:17:15.901 DEBUG:teuthology.provision.fog.smithi118:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-28T18:17:15.901 DEBUG:teuthology.provision.fog.smithi118:FOG request: PUT /host/223 {"imageID": 6} 2023-06-28T18:17:15.961 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-06-28T18:17:15.962 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 6} 2023-06-28T18:17:15.965 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of ubuntu 22.04 2023-06-28T18:17:15.965 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-28T18:17:15.967 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 22.04 2023-06-28T18:17:15.967 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T18:17:16.017 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of ubuntu 22.04 2023-06-28T18:17:16.018 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-28T18:17:21.023 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:17:21.025 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:17:31.075 DEBUG:teuthology.provision.fog.smithi118:FOG request: POST /host/223/task {"taskTypeID": 1} 2023-06-28T18:17:31.076 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-06-28T18:17:41.090 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T18:17:46.098 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-28T18:17:51.106 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T18:17:56.114 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-06-28T18:17:56.171 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-28T18:18:01.717 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-28T18:18:01.718 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:18:01.735 INFO:teuthology.orchestra.console:Power off smithi033 2023-06-28T18:18:01.735 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:18:01.749 INFO:teuthology.orchestra.console:Power off smithi188 2023-06-28T18:18:01.749 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:18:01.758 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:01.767 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:01.777 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:01.888 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-06-28T18:18:01.989 INFO:teuthology.orchestra.console:Power on smithi118 2023-06-28T18:18:01.990 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:18:02.009 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:05.791 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:05.801 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:06.033 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:10.904 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:10.912 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:11.143 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:16.016 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:16.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:16.234 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-06-28T18:18:16.254 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:16.337 INFO:teuthology.orchestra.console:Power on smithi188 2023-06-28T18:18:16.359 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:18:16.383 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:20.412 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:21.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:21.369 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:24.524 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:24.735 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2023-06-28T18:18:24.836 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-06-28T18:18:24.837 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-06-28T18:18:25.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:18:26.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:26.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:31.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:31.591 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:36.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:36.702 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:36.912 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-06-28T18:18:37.013 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-06-28T18:18:37.014 DEBUG:teuthology.provision.fog.smithi118:FOG request: GET /task/active None 2023-06-28T18:18:37.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:18:40.144 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-28T18:18:41.572 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:43.956 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:18:46.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:18:46.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:49.200 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-28T18:18:49.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:18:51.793 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:18:53.040 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:18:55.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:00.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:00.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:05.221 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-28T18:19:08.272 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:19:10.224 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:11.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:16.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:21.235 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-28T18:19:21.336 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-06-28T18:19:21.437 INFO:teuthology.orchestra.console:Power on smithi033 2023-06-28T18:19:21.437 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T18:19:24.304 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:19:26.506 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:27.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:32.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:37.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:40.304 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:19:42.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:46.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:47.474 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:49.360 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:19:50.772 WARNING:teuthology.provision.fog.smithi118:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-06-28T18:19:52.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:55.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:56.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:19:56.892 ERROR:teuthology.orchestra.connection:Error authenticating with smithi118.front.sepia.ceph.com: Authentication failed. 2023-06-28T18:19:56.894 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:19:56.894 DEBUG:teuthology.orchestra.run.smithi118:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:19:56.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:19:57.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:19:57.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:19:58.416 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:19:58.913 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:19:59.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:00.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:01.928 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:02.807 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:20:02.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:03.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:04.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:09.421 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:20:09.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:10.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:11.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:12.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:12.496 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:20:13.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:14.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:14.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:20:14.748 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2023-06-28T18:20:14.849 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-06-28T18:20:14.850 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-06-28T18:20:19.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:19.856 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:19.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:20.863 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:21.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:22.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:23.880 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:24.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:25.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:26.897 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:27.903 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:28.909 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:29.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:30.192 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:20:30.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:31.927 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:32.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:33.940 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:34.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:35.952 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:36.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:41.198 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T18:20:41.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:42.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:42.493 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-06-28T18:20:43.210 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:44.215 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:45.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:46.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:47.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:47.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:48.239 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:48.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:48.574 ERROR:teuthology.orchestra.connection:Error authenticating with smithi188.front.sepia.ceph.com: Authentication failed. 2023-06-28T18:20:48.575 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:20:48.576 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:20:48.577 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:49.247 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:49.586 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:50.256 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:50.256 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T18:20:50.595 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:51.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:51.604 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:52.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:52.614 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:53.284 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:53.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:54.294 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:54.632 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:55.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:55.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:56.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:20:56.311 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:56.650 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:57.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:57.659 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:58.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:58.668 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:59.316 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T18:20:59.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:20:59.677 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:00.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:00.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:01.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:01.695 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:02.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:02.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:03.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:03.714 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:04.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:04.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:05.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:21:10.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:10.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:11.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:11.327 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:12.332 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:12.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:13.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:13.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:14.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:14.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:15.350 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:15.351 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:16.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:16.360 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:17.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:17.366 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:18.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:18.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:19.378 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:19.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:20.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:20.385 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:21.391 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:21.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:22.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:22.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:23.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:23.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:24.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:24.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:25.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:25.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:26.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:26.425 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:27.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:27.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:28.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:28.438 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:28.816 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-06-28T18:21:29.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:29.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:30.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:30.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:31.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:31.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:32.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:32.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:33.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:33.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:34.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:34.478 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:34.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T18:21:39.822 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:39.823 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:39.937 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2023-06-28T18:21:39.937 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T18:21:39.938 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T18:21:39.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:40.830 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:40.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:40.946 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:41.839 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:41.840 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:41.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:42.848 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:42.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:43.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:43.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:44.867 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:44.989 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:45.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:45.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:46.886 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:47.008 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:47.895 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:48.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:48.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:49.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:49.914 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:50.036 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:50.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:51.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:51.931 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:52.053 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:52.941 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:53.063 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:53.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:54.073 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:54.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:55.082 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:55.968 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:56.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:56.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:57.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:57.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:58.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:58.996 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:21:59.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:00.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:00.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:01.017 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:01.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:02.028 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:02.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:03.038 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:03.161 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:04.047 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:04.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:05.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:05.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:06.068 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:06.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:07.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:07.201 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:08.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:08.211 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:09.099 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:09.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:10.109 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:10.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:11.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:11.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:12.129 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:12.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:13.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:13.261 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:14.150 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:14.272 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:15.282 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:16.291 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:17.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:18.310 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:19.320 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:20.330 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:21.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:22.348 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:23.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:24.367 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:25.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:26.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:27.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:28.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:29.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:30.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:31.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:32.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:33.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:34.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:35.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:36.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:37.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:38.500 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:39.508 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:40.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:41.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:42.541 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:43.550 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:44.561 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:45.571 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:46.580 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:47.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:48.601 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:49.611 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:50.623 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:51.633 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:52.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:53.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:54.661 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:55.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:56.680 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:57.689 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:58.699 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:22:59.709 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:00.718 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:01.727 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:02.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:03.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:04.755 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:05.765 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:06.775 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:07.785 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:08.794 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:09.804 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:23:10.814 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T18:24:02.676 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-06-28T18:24:02.680 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer 2023-06-28T18:24:02.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T18:24:02.682 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T18:24:07.981 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T18:24:23.044 DEBUG:teuthology.nuke:shortname: smithi033 2023-06-28T18:24:23.045 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:24:28.084 DEBUG:teuthology.nuke:shortname: smithi118 2023-06-28T18:24:28.084 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:24:28.089 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_15:05:37-rbd-wip-yuri11-testing-2023-06-27-0812-reef-distro-default-smithi/7320703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:15:49.543622', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFOrGN2JOuXLNXm3KFYihPL6qIxP9LzVsiHV9G+SSypSU8ZQ4VyCJJHpngvX0zCafyC+/l+GOy112S6Ve1h/nw='} 2023-06-28T18:24:28.116 DEBUG:teuthology.nuke:shortname: smithi188 2023-06-28T18:24:28.117 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T18:24:28.118 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_15:05:37-rbd-wip-yuri11-testing-2023-06-27-0812-reef-distro-default-smithi/7320703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:15:49.542383', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDl6pxxENOl9sLrVfug3TzN2uzm7qE2hb1b+8D9Jn1yoFXzKMA+T/UDYXiPSNw5rRnj+sFibMztGKn2F6TIn+gzFKOfXIz4kJZTIfFr+NZ7/LFxgcQQ6sCVuPAnXq7Ck2z2Mf3HyDz4JzG4GrkO3q8+vVdXBQfAhPqUIT/B8oh27wsgF//lVGcxm4LjPWaCIbU35ladd16dpGCBX2CVFrAO0fHAtS6nlIZtQHqvg8Jj775s/8DrPJ6sVE945Otd013CiTZHZCCErYBxOowFA8g3QkL/M9M17oeAAgxF6AZWZbMzKpAxTGqDbYLyYcQzwAztd8LbDwX3dQTyEoxloosmWGbsuadRuxK70bKLMR4vLu4G5/a+XX7+YzWxpojr4uv4Twgnee/dyvWCmnMqM076Fl50piUiUQgzXayp766iWnEPYQ7VyZqT4etnHe3WgTEehkj9URvgk1FIxJJQBfAPl8C6yHYFjetXgRy19NYB74132i03S+4ThTkEYgXb8zM='} 2023-06-28T18:24:28.140 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-28_15:05:37-rbd-wip-yuri11-testing-2023-06-27-0812-reef-distro-default-smithi/7320703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 18:15:49.540752', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDFp4f4HR9ikrxr81ZRLe86UydnPalvxSDCBAFJiMPHPbPjT7NevzKiist5PbVO6seP65aajFsdqT1O5NFTqJ3o='} 2023-06-28T18:24:28.151 INFO:teuthology.orchestra.console:Power off smithi033 2023-06-28T18:24:28.152 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:24:28.174 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:28.191 INFO:teuthology.orchestra.console:Power off smithi118 2023-06-28T18:24:28.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:24:28.208 INFO:teuthology.orchestra.console:Power off smithi188 2023-06-28T18:24:28.209 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T18:24:28.217 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:28.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:32.218 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:32.241 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:32.252 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:37.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:37.351 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:37.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T18:24:37.571 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-06-28T18:24:47.709 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2023-06-28T18:24:47.710 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-06-28T18:24:47.734 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com 2023-06-28T18:25:05.833 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-06-28T18:25:05.841 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-06-28T18:25:21.217 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 301, in read_all x = self.__socket.recv(n) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 657, in recv return self._sock.recv(*args) ConnectionResetError: [Errno 104] Connection reset by peer