2023-06-28T10:58:35.740 INFO:root:teuthology version: 0.0.1.dev132+gaa9345a 2023-06-28T10:58:35.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T10:58:35.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T10:58:35.943 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f008449f3a0>, signals=[15]) 2023-06-28T10:58:35.945 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-06-28T10:58:35.946 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T10:58:35.946 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-06-28T10:58:35.974 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2023-06-28T10:58:35.975 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T10:58:35.975 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-06-28T10:58:35.977 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-06-28T10:58:37.947 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2023-06-28T10:58:37.947 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2023-06-28T10:58:37.948 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-06-28T10:58:37.950 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /host {"name": "smithi119"} 2023-06-28T10:58:57.958 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /host {"name": "smithi195"} 2023-06-28T10:58:58.059 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T10:58:58.066 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T10:59:03.110 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T10:59:03.111 DEBUG:teuthology.provision.fog.smithi119:FOG request: PUT /host/224 {"imageID": 2} 2023-06-28T10:59:03.112 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T10:59:03.112 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 2} 2023-06-28T10:59:18.150 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-28T10:59:23.158 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of ubuntu 20.04 2023-06-28T10:59:23.158 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-06-28T10:59:23.159 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of ubuntu 20.04 2023-06-28T10:59:23.159 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-28T10:59:32.760 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-28T10:59:32.760 DEBUG:teuthology.provision.fog.smithi195:FOG request: PUT /host/300 {"imageID": 2} 2023-06-28T10:59:32.763 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T10:59:32.772 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T10:59:32.808 DEBUG:teuthology.provision.fog.smithi119:FOG request: POST /host/224/task {"taskTypeID": 1} 2023-06-28T10:59:32.817 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of ubuntu 20.04 2023-06-28T10:59:32.818 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T10:59:32.820 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-06-28T10:59:32.867 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-06-28T10:59:32.879 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-28T10:59:32.883 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /tasktype {"name": "deploy"} 2023-06-28T10:59:32.930 DEBUG:teuthology.provision.fog.smithi195:FOG request: POST /host/300/task {"taskTypeID": 1} 2023-06-28T10:59:37.986 INFO:teuthology.orchestra.console:Power off smithi119 2023-06-28T10:59:37.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T10:59:37.999 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T10:59:38.007 INFO:teuthology.orchestra.console:Power off smithi090 2023-06-28T10:59:38.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T10:59:38.019 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:38.030 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:38.103 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-28T10:59:38.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T10:59:38.127 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:38.143 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-06-28T10:59:38.154 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-06-28T10:59:38.245 INFO:teuthology.orchestra.console:Power on smithi119 2023-06-28T10:59:38.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T10:59:38.255 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-28T10:59:38.255 INFO:teuthology.orchestra.console:Power on smithi090 2023-06-28T10:59:38.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T10:59:38.267 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:38.278 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:38.356 INFO:teuthology.orchestra.console:Power on smithi195 2023-06-28T10:59:38.357 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-28T10:59:42.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:42.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:43.384 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:47.405 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:47.413 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:47.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:52.516 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:52.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:52.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:52.744 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-06-28T10:59:52.845 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-06-28T10:59:52.846 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-06-28T10:59:52.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T10:59:55.984 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T10:59:57.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:57.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T10:59:57.840 INFO:teuthology.orchestra.console:Power on for smithi119 completed 2023-06-28T10:59:57.941 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2023-06-28T10:59:57.942 DEBUG:teuthology.provision.fog.smithi119:FOG request: GET /task/active None 2023-06-28T10:59:58.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:01.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:02.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:00:05.040 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T11:00:07.863 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:00:08.074 INFO:teuthology.orchestra.console:Power on for smithi195 completed 2023-06-28T11:00:08.175 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2023-06-28T11:00:08.176 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:00:13.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:18.189 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-28T11:00:21.268 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T11:00:24.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:29.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:34.201 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:00:34.202 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-28T11:00:39.209 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T11:00:40.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:43.284 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-28T11:00:45.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:48.272 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T11:00:49.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:00:54.289 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:00:54.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:01:04.300 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T11:01:10.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:01:12.688 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-06-28T11:01:18.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:01:18.806 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: Authentication failed. 2023-06-28T11:01:18.808 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T11:01:18.808 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T11:01:18.809 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:19.387 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:01:24.393 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:25.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:26.403 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:27.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:28.413 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:28.820 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-06-28T11:01:29.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:30.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:31.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:32.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:33.444 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:34.450 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:34.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:01:39.828 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:01:39.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:40.043 ERROR:teuthology.orchestra.connection:Error authenticating with smithi090.front.sepia.ceph.com: Authentication failed. 2023-06-28T11:01:40.044 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-28T11:01:40.044 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-28T11:01:40.045 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:40.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:41.052 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:41.883 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:42.059 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:42.890 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:43.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:43.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:44.075 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:44.907 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:45.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:45.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:46.092 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:46.924 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:47.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:47.934 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:48.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:48.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:49.121 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:49.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:50.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:50.961 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:51.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:51.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:52.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:52.978 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:53.154 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:53.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:54.162 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:54.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:55.110 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:01:55.749 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:56.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:56.756 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:57.058 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:57.762 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:58.064 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:58.768 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:59.070 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:01:59.774 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:00.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:00.781 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:01.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:01.788 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:02.090 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:02.795 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:03.097 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:03.801 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:04.102 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:04.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:05.108 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:05.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:06.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:06.818 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:07.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:07.824 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:08.125 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:08.829 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:09.130 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:09.834 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:10.135 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:10.840 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:10.845 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:02:15.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:15.855 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:16.861 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:16.862 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:17.868 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:17.869 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:18.874 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:18.875 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:19.881 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:19.881 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:20.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:20.887 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:21.893 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:21.893 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:22.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:22.899 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:23.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:23.905 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:24.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:24.910 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:25.916 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:25.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:26.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:26.923 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:27.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:27.930 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:28.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:28.936 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:29.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:29.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:30.933 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:02:35.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:35.938 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:36.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:36.944 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:37.950 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:37.951 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:38.956 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:38.957 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:39.962 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:39.963 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:40.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:40.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:41.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:41.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:42.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:42.981 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:43.986 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:43.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:44.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:44.993 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:45.999 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:45.999 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:47.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:47.006 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:48.011 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:48.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:49.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:49.018 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:50.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:50.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:51.012 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:02:51.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:51.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:52.376 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:52.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:53.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:53.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:54.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:54.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:55.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:55.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:56.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:56.401 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:57.408 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:57.409 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:58.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:58.414 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:59.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:02:59.420 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:00.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:00.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:01.432 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:01.433 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:02.439 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:02.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:03.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:03.447 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:04.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:04.453 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:05.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:05.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:06.440 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:03:11.445 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:11.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:12.452 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:12.455 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:13.459 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:13.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:14.466 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:14.469 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:15.473 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:15.476 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:16.480 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:16.483 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:17.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:18.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:19.507 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:20.515 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:21.523 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:22.530 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:23.538 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:24.546 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:25.553 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:26.512 DEBUG:teuthology.provision.fog.smithi195:FOG request: GET /task/active None 2023-06-28T11:03:31.518 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:31.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:03:36.640 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:37.645 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:38.651 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:39.657 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-06-28T11:03:39.696 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:03:39.834 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError 2023-06-28T11:03:39.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-28T11:03:39.835 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-28T11:03:44.928 INFO:teuthology.nuke:Checking targets against current locks 2023-06-28T11:03:49.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:04:04.963 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:04:04.995 DEBUG:teuthology.nuke:shortname: smithi090 2023-06-28T11:04:04.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T11:04:05.019 DEBUG:teuthology.nuke:shortname: smithi119 2023-06-28T11:04:05.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T11:04:05.021 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:57:36-orch-reef-release-distro-default-smithi/7319599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 10:58:34.887796', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5X+OSEiAiVp9dd8OqfmWevrIXbMeh6Xa18L9jIq/dtPkE0sutQdndD92tAnVrD7NovWZbuMZHCv7VJiZQltU7VNZ+DAgyNIhKh15Wh7n04UcrvPWA8CifFJnMZpldt3PHca2nldlNo2u5ReTb4Cbz3Vy7VOHWTXggaMPX8qm73MreuEkwV/yNH8eHLy8Czr7Z3lgCWY9Vp26KJFGgQsameYKZwlpGGsQ8TJv2kIArHUHb4l7V5rlX4ywyBPaQ9dPkcXX84CXYpWlBsWDPW+aAC6M7MJ2RlelWdsBK0DwQzv1yXrRiKWBFr7ml64NSOkqiRSYm9e9IbhVF9knP1/k57cMvkWJHOl/fseXtf+Ul/c1ooG/fA2oUUNS4ELp3rru725d/TZGJWdSAdfTnefUr32yiNI81WBk4BkqK0PdWTtILX5SenosIQrdGIX66g9Cf3VjgqPWAUFt6Id4rlqGEt/d/CBmF1i8y0PAmxl+8bU9X9laVWgrL6VJpKD/St8U='} 2023-06-28T11:04:05.047 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:57:36-orch-reef-release-distro-default-smithi/7319599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 10:58:34.891191', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-06-28T11:04:05.053 DEBUG:teuthology.nuke:shortname: smithi195 2023-06-28T11:04:05.054 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-28T11:04:05.071 INFO:teuthology.orchestra.console:Power off smithi090 2023-06-28T11:04:05.072 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:04:05.084 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-27_22:57:36-orch-reef-release-distro-default-smithi/7319599', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-28 10:58:34.894125', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFY4flzH3IjSraA2821spz+k84L7R4VnvPD+Jy2KNCZnBAPSv/AXrsGCgMVhRSWjOotENeW3D81Ge0JSYa8Z9pLuy013rnZ0uJbdgsbz4Nz/dJIWl3PrFdgygVhP3MnWD6bwnDSL9zj7KhVDqljmHzK6YgtOSLY6AkQo2G2rOMZmxvz/AHIt5FhZLOvLp6T9j1GDnlXinqgyTQym5N5vFAW55FPHXgwT2aptsrc3KtZY9+5AIH+dMz4VswRsAG1cG0/LldhHSCtDjG28yif488lr5n7hQ2EL/5m9K3ZUhnk5kRNSe2FQGYhCkHmCzQBS/D4a3jL2/yZ5G5UZwEaGbC/vfNeDkmjteJbie4Pi1VNhnELjXMcKy8Y90WcPwwc7KujYxJxvKHpt2eX/WR5leHOWP4DWfTK2HViGW8jZqoSDeAIKBubG396PAZMWVJgTlQ/ow7pvT8D1QIjjhsQdfZr9R1pRXpPOZfOa1yzz+alhWQLbUau7LqBpwNnlKDW8k='} 2023-06-28T11:04:05.093 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:05.116 INFO:teuthology.orchestra.console:Power off smithi119 2023-06-28T11:04:05.117 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:04:05.139 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:05.154 INFO:teuthology.orchestra.console:Power off smithi195 2023-06-28T11:04:05.156 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-28T11:04:05.177 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:09.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:09.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:09.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:09.377 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-06-28T11:04:09.410 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-06-28T11:04:14.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:04:19.491 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:21.181 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com 2023-06-28T11:04:21.188 INFO:teuthology.lock.ops:unlocked: smithi195.front.sepia.ceph.com 2023-06-28T11:04:22.544 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:04:26.116 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:28.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:04:31.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:33.072 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:04:36.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:39.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:04:44.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:47.152 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:04:49.191 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:53.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:04:54.300 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:04:56.208 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:04:59.410 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:05:02.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-28T11:05:07.214 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-28T11:05:07.427 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-06-28T11:05:12.532 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-06-28T11:05:12.990 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-06-28T11:05:13.367 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/provision/fog.py", line 295, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 450, in run r.execute() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/teuthology/orchestra/run.py", line 97, in execute self.client.exec_command(self.command, timeout=self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 510, in exec_command chan = self._transport.open_session(timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 919, in open_session return self.open_channel( File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1050, in open_channel raise e File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2109, in run ptype, m = self.packetizer.read_message() File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 459, in read_message header = self.read_all(self.__block_size_in, check_rekey=True) File "/home/teuthworker/src/git.ceph.com_teuthology_aa9345a996190b15ab9d46b5969b5f8280bfba99/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 303, in read_all raise EOFError() EOFError