2023-07-27T03:23:49.838 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-27T03:23:49.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T03:23:49.839 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T03:24:04.970 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2479e641f0>, signals=[15]) 2023-07-27T03:24:04.972 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2023-07-27T03:24:04.973 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2023-07-27T03:24:04.974 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-07-27T03:24:09.996 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /host {"name": "smithi130"} 2023-07-27T03:24:25.077 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-27T03:24:25.312 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_8.stream (ID 3) 2023-07-27T03:24:25.313 DEBUG:teuthology.provision.fog.smithi130:FOG request: PUT /host/235 {"imageID": 3} 2023-07-27T03:24:25.359 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 8.stream 2023-07-27T03:24:25.360 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:24:25.414 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /tasktype {"name": "deploy"} 2023-07-27T03:24:25.451 DEBUG:teuthology.provision.fog.smithi130:FOG request: POST /host/235/task {"taskTypeID": 1} 2023-07-27T03:24:25.509 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:24:30.603 INFO:teuthology.orchestra.console:Power off smithi130 2023-07-27T03:24:30.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T03:24:35.628 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T03:24:35.629 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:24:36.640 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:24:40.644 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:24:41.753 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:24:45.756 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:24:46.866 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:24:50.871 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:24:51.980 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:24:55.982 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:24:57.092 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:25:01.094 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:25:02.205 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:25:06.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:25:06.315 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T03:25:06.416 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2023-07-27T03:25:06.517 INFO:teuthology.orchestra.console:Power on smithi130 2023-07-27T03:25:06.517 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-27T03:25:06.538 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-27T03:25:06.539 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:25:06.560 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T03:25:10.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:25:11.672 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:25:15.673 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:25:16.783 DEBUG:teuthology.orchestra.console:check power output: 2023-07-27T03:25:20.785 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:25:20.894 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T03:25:20.995 INFO:teuthology.orchestra.console:Power on for smithi130 completed 2023-07-27T03:25:21.096 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2023-07-27T03:25:21.096 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:25:36.176 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:25:56.281 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:26:16.379 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:26:31.488 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:26:46.572 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:27:01.748 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-07-27T03:27:01.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T03:27:01.901 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: Authentication failed. 2023-07-27T03:27:01.903 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-27T03:27:01.904 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-27T03:27:01.906 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:02.911 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:03.917 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:04.922 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:05.927 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:06.932 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:07.937 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:08.942 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:09.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:10.953 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:11.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:12.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:13.970 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:14.975 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:15.980 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:16.985 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:17.990 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:18.995 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:20.000 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:21.005 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:22.010 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:23.015 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:24.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:25.025 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:26.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:27.035 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:28.041 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:29.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:30.051 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:31.057 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:32.062 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:33.066 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:34.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:35.076 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:36.081 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:37.086 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:38.091 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:39.096 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:40.101 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:41.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:42.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:43.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:44.119 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:45.124 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:46.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:47.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:48.137 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:49.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:50.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:51.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:52.156 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:53.160 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:54.165 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:55.170 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:56.174 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:57.179 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:58.183 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:27:59.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:00.193 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:01.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:02.204 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:03.208 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:04.213 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:05.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:06.222 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:07.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:08.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:09.236 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:10.240 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:11.245 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:12.250 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:13.255 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:14.260 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:15.265 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:16.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:17.275 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:18.280 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:19.285 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:20.290 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:21.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:22.300 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:23.305 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:24.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:25.314 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:26.319 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:27.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:28.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:29.333 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:30.338 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:31.343 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:32.349 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:33.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:34.358 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:35.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:36.368 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:37.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:38.379 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:39.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:40.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:41.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:42.398 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:43.402 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:44.406 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:45.411 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:46.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:47.421 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:48.426 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:49.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:50.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:51.441 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:52.446 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:53.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:54.456 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:55.462 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:56.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:57.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:58.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:28:59.482 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:29:00.487 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:29:01.492 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:29:01.792 ERROR:teuthology.provision.fog: on smithi130 2023-07-27T03:29:10.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-27T03:29:10.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T03:29:10.878 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: Authentication failed. 2023-07-27T03:29:10.878 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-27T03:29:10.879 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:31:19.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-27T03:31:19.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T03:31:19.931 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: Authentication failed. 2023-07-27T03:31:19.932 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-27T03:31:19.933 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:33:31.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-27T03:33:31.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T03:33:36.947 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: Authentication failed. 2023-07-27T03:33:36.948 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-27T03:33:36.949 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:35:39.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-07-27T03:35:39.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-27T03:35:44.958 ERROR:teuthology.orchestra.connection:Error authenticating with smithi130.front.sepia.ceph.com: Authentication failed. 2023-07-27T03:35:44.959 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-07-27T03:35:44.959 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-27T03:37:44.853 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-07-27T03:37:44.856 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi130 2023-07-27T03:37:44.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-27T03:37:44.857 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-27T03:37:49.944 INFO:teuthology.nuke:Checking targets against current locks 2023-07-27T03:37:54.136 DEBUG:teuthology.nuke:shortname: smithi130 2023-07-27T03:37:54.136 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-27T03:37:54.156 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-26_15:54:22-rados-wip-yuri6-testing-2023-07-24-0819-pacific-distro-default-smithi/7353445', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-27 03:23:39.116256', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYIxjGWAwJUjn1HHTc1r3EXo8kEMg/AAJeIPCdTzkQiPXyVk+GGkXO+AMbIG0zw/vbLUYHJhunUdLQMrEv59JebHsxzFiKV096Z+aCOHYE3nFKD4Fe/iRL5jBDEPIfvOzH0ekBsvt/kjtLYGFSF5RWXEv9dKyiYKrEVx6KGf54YCn458noJ+xqsQidRWqFAbwUPkOPB99aQtbAGkmMf8NXVEPKMdraiSo+S5fAzEl0cnl2AiZcsOOgku7dldKIPHk0/tfssFAgfiI7fGojUnusxT01pEzJC2WKJ1YSTt6BvMxT4l+fB7t1G2omSza+DPlNiyTCC+8NViaWMgEYXff4VO20Qsjw57YUV0yy1sRa9NZWMBtM8yUoZdfRayTtAINNIIPxsfSez2DSbkVILQ3Q0XHmxzYAUiaCXHcgkcpFocCd7rX/rlqPKKbJWSjFhiNo7n7IkfwD1AZ8xqCHhmK8kFItrOg9haRbinqeoTyfTjekV5oiR4Q6YaNjat0gzfM='} 2023-07-27T03:37:54.206 INFO:teuthology.orchestra.console:Power off smithi130 2023-07-27T03:37:54.206 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-27T03:37:54.230 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-27T03:37:54.231 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:37:54.255 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T03:37:58.256 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:37:58.366 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T03:38:02.368 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:38:02.477 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-27T03:38:06.480 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-27T03:38:06.590 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-27T03:38:06.691 INFO:teuthology.orchestra.console:Power off for smithi130 completed 2023-07-27T03:38:16.856 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com 2023-07-27T03:38:20.070 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 57, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/dispatcher/supervisor.py", line 227, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/provision/fog.py", line 299, in _wait_for_ready self.remote.run(args=cmd, timeout=600) File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/remote.py", line 521, in run raise Exception(f'Cannot connect to remote host {self.shortname}') Exception: Cannot connect to remote host smithi130