2023-08-16T02:32:59.209 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-16T02:32:59.210 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T02:33:19.019 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5d33eeef70>, signals=[15]) 2023-08-16T02:33:19.021 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-08-16T02:33:19.022 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T02:33:19.022 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-08-16T02:33:24.067 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-08-16T02:33:24.067 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-08-16T02:33:24.067 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-08-16T02:33:24.069 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-08-16T02:33:35.332 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /host {"name": "smithi141"} 2023-08-16T02:33:40.359 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-16T02:33:50.395 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-16T02:33:55.401 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-16T02:33:55.401 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 6} 2023-08-16T02:33:56.254 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-16T02:33:56.255 DEBUG:teuthology.provision.fog.smithi141:FOG request: PUT /host/246 {"imageID": 6} 2023-08-16T02:34:01.262 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of ubuntu 22.04 2023-08-16T02:34:01.263 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:34:01.332 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of ubuntu 22.04 2023-08-16T02:34:01.333 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-16T02:34:01.338 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T02:34:01.387 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-08-16T02:34:01.391 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /tasktype {"name": "deploy"} 2023-08-16T02:34:01.427 DEBUG:teuthology.provision.fog.smithi141:FOG request: POST /host/246/task {"taskTypeID": 1} 2023-08-16T02:34:01.458 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:34:01.479 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-16T02:34:11.563 INFO:teuthology.orchestra.console.smithi049:Power off 2023-08-16T02:34:11.564 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T02:34:11.581 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-16T02:34:11.582 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T02:34:16.592 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-08-16T02:34:16.593 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:16.607 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-16T02:34:16.608 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:16.629 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-16T02:34:17.604 DEBUG:teuthology.orchestra.console.smithi049:check power output: 2023-08-16T02:34:20.634 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:21.606 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:21.743 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:34:22.716 DEBUG:teuthology.orchestra.console.smithi049:check power output: 2023-08-16T02:34:25.744 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:26.717 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:26.828 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-16T02:34:26.855 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:34:26.929 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-08-16T02:34:27.030 INFO:teuthology.orchestra.console.smithi049:Power on 2023-08-16T02:34:27.031 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T02:34:30.856 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:31.968 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:34:35.972 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:37.059 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-08-16T02:34:37.060 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:37.083 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:34:38.071 DEBUG:teuthology.orchestra.console.smithi049:check power output: 2023-08-16T02:34:41.084 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:41.195 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-16T02:34:41.296 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-16T02:34:41.397 INFO:teuthology.orchestra.console.smithi141:Power on 2023-08-16T02:34:41.398 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-16T02:34:42.073 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:43.184 DEBUG:teuthology.orchestra.console.smithi049:check power output: 2023-08-16T02:34:46.422 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-08-16T02:34:46.423 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:47.186 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:47.296 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-16T02:34:47.397 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-08-16T02:34:47.431 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:34:47.498 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-08-16T02:34:47.498 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:34:51.435 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:52.544 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:34:56.546 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:34:57.657 DEBUG:teuthology.orchestra.console.smithi141:check power output: 2023-08-16T02:35:01.658 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T02:35:02.586 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:35:07.595 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-16T02:35:07.696 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-08-16T02:35:07.797 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-08-16T02:35:07.797 DEBUG:teuthology.provision.fog.smithi141:FOG request: GET /task/active None 2023-08-16T02:35:12.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:35:15.824 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-16T02:35:21.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:35:22.681 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:35:27.689 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-16T02:35:33.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:35:41.778 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-16T02:35:42.772 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:35:47.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:35:55.856 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-08-16T02:36:01.804 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:36:06.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:36:26.912 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-16T02:36:26.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:36:27.229 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:36:27.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T02:36:27.231 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T02:36:27.232 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:28.237 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:29.242 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:30.248 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:31.253 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:32.259 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:33.264 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:34.270 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:35.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:36.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:37.289 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:38.295 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:39.303 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:40.309 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:41.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:42.321 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:43.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:44.334 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:45.341 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:46.346 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:47.353 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:48.359 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:49.365 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:50.371 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:51.377 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:52.386 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:53.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:54.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:55.404 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:56.410 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:57.416 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:58.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:36:59.431 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:00.437 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:01.443 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:02.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:03.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:04.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:05.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:06.471 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:07.477 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:08.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:09.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:10.498 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:11.504 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:12.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:13.528 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:14.534 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:15.539 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:16.545 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:17.552 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:18.557 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:19.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:20.568 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:21.573 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:22.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:23.584 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:24.590 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:25.597 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:26.603 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:26.959 WARNING:teuthology.provision.fog.smithi049:timed out 2023-08-16T02:37:27.610 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:28.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:29.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:30.628 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:31.634 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:32.641 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:32.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:37:37.969 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:38.186 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-16T02:37:38.187 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-16T02:37:38.652 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-08-16T02:37:38.653 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-08-16T02:37:38.697 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-08-16T02:37:38.698 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-08-16T02:37:38.746 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-08-16T02:37:38.747 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-08-16T02:37:38.861 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-08-16T02:37:38.875 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-08-16T02:37:38.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-08-16T02:37:38.977 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:38.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-08-16T02:37:39.045 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-08-16T02:37:39.090 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-16T02:37:39.091 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2023-08-16T02:37:39.091 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2023-08-16T02:37:39.091 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-16T02:37:39.092 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2023-08-16T02:37:39.092 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2023-08-16T02:37:39.092 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2023-08-16T02:37:39.093 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-16T02:37:39.093 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-16T02:37:39.093 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-16T02:37:39.093 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-16T02:37:39.093 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2023-08-16T02:37:39.094 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-08-16T02:37:39.095 DEBUG:teuthology.parallel:result is None 2023-08-16T02:37:39.982 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:40.987 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:41.992 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:42.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:44.003 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:45.009 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:46.014 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:47.020 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:48.026 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:49.031 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:50.037 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:51.043 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:52.049 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:53.054 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:54.060 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:55.065 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:56.071 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:57.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:58.083 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:37:59.088 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:00.094 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:01.100 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:02.105 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:03.110 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:04.116 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:05.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:06.128 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:07.133 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:08.139 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:09.146 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:10.151 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:11.157 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:12.163 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:13.168 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:14.175 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:15.181 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:16.188 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:17.194 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:18.199 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:19.205 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:20.210 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:21.216 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:22.221 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:23.227 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:24.233 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:25.238 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:26.243 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:38:27.123 ERROR:teuthology.provision.fog: on smithi141 2023-08-16T02:38:36.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:38:36.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:38:41.248 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:38:41.248 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:38:41.249 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:40:50.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:40:50.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:40:55.227 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:40:55.227 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:40:55.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:43:07.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:43:07.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:43:07.286 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:43:07.286 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:43:07.288 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:45:10.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:45:10.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:45:15.260 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:45:15.261 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:45:15.262 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:47:15.189 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T02:47:15.190 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T02:47:27.202 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:47:27.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:47:32.320 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:47:32.321 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:47:32.322 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:49:41.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:49:41.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:49:46.334 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:49:46.334 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:49:46.336 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:51:58.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:51:58.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:52:03.353 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:52:03.354 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:52:03.355 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:54:06.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:54:06.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:54:06.363 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:54:06.364 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:54:06.364 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:56:06.257 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T02:56:06.258 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T02:56:21.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:56:21.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:56:26.388 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:56:26.389 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:56:26.390 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T02:58:35.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T02:58:35.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T02:58:40.403 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T02:58:40.404 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T02:58:40.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:00:52.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:00:52.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:00:52.422 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:00:52.423 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:00:52.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:02:55.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:02:55.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:03:00.391 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:03:00.391 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:03:00.392 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:05:00.326 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:05:00.326 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:05:18.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:05:18.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:05:23.459 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:05:23.459 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:05:23.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:07:32.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:07:32.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:07:32.473 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:07:32.474 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:07:32.475 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:09:44.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:09:44.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:09:44.488 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:09:44.489 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:09:44.490 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:11:47.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:11:47.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:11:52.500 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:11:52.501 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:11:52.502 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:13:52.397 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:13:52.397 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:14:13.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:14:13.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:14:18.491 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:14:18.492 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:14:18.493 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:16:27.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:16:27.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:16:27.547 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:16:27.547 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:16:27.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:18:39.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:18:39.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:18:44.560 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:18:44.561 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:18:44.562 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:20:47.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:20:47.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:20:52.576 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:20:52.577 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:20:52.578 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:22:52.470 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:22:52.471 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:23:16.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:23:16.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:23:16.605 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:23:16.606 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:23:16.606 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:25:25.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:25:25.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:25:30.621 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:25:30.622 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:25:30.622 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:27:42.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:27:42.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:27:42.640 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:27:42.641 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:27:42.642 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:29:45.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:29:45.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:29:50.653 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:29:50.653 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:29:50.654 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:31:50.545 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:31:50.545 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:32:17.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:32:17.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:32:22.685 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:32:22.686 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:32:22.687 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:34:31.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:34:31.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:34:31.704 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:34:31.704 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:34:31.705 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:36:43.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:36:43.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:36:48.723 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:36:48.723 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:36:48.724 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:38:51.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:38:51.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:38:56.735 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:38:56.736 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:38:56.737 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:40:56.629 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:40:56.629 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:41:26.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:41:26.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:41:26.768 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:41:26.768 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:41:26.769 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:43:35.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:43:35.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:43:40.740 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:43:40.741 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:43:40.742 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:45:52.688 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:45:52.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:45:52.801 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:45:52.802 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:45:52.803 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:47:55.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:47:55.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:48:00.810 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:48:00.811 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:48:00.812 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:50:00.705 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:50:00.705 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:50:33.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:50:33.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:50:38.853 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:50:38.854 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:50:38.854 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:52:47.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:52:47.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:52:52.829 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:52:52.830 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:52:52.831 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:55:04.776 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:55:04.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:55:04.891 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:55:04.891 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:55:04.892 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:57:07.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:57:07.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:57:12.901 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:57:12.902 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:57:12.904 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T03:59:12.793 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T03:59:12.793 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T03:59:48.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T03:59:48.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T03:59:48.871 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T03:59:48.872 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T03:59:48.873 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:01:57.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:01:57.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:01:57.925 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:01:57.925 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:01:57.926 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:04:09.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:04:09.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:04:09.942 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:04:09.943 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:04:09.943 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:06:12.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:06:12.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:06:12.954 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:06:12.954 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:06:12.955 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:08:12.847 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T04:08:12.847 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T04:08:51.884 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:08:51.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:08:51.996 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:08:51.997 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:08:51.998 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:11:00.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:11:00.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:11:01.010 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:11:01.011 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:11:01.012 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:13:12.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:13:12.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:13:18.025 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:13:18.026 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:13:18.027 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:15:20.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:15:20.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:15:21.038 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:15:21.039 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:15:21.040 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:17:20.929 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T04:17:20.929 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T04:18:02.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:18:02.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:18:08.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:18:08.084 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:18:08.084 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:20:16.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:20:16.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:20:22.102 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:20:22.103 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:20:22.104 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:22:34.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:22:34.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:22:34.121 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:22:34.122 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:22:34.122 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:24:37.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:24:37.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:24:42.133 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:24:42.133 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:24:42.134 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:26:42.028 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T04:26:42.029 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T04:27:27.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:27:27.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:27:32.189 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:27:32.190 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:27:32.191 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:29:41.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:29:41.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:29:41.198 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:29:41.199 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:29:41.200 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:31:53.104 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:31:53.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:31:53.174 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:31:53.175 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:31:53.176 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:33:56.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:33:56.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:33:56.223 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:33:56.223 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:33:56.224 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:35:56.119 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T04:35:56.120 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T04:36:44.161 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:36:44.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:36:49.277 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:36:49.278 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:36:49.279 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:38:58.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:38:58.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:38:58.250 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:38:58.250 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:38:58.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:41:10.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:41:10.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:41:15.314 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:41:15.314 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:41:15.315 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:43:18.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:43:18.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:43:23.324 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:43:23.325 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:43:23.326 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:45:23.219 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T04:45:23.220 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T04:46:14.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:46:14.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:46:19.370 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:46:19.371 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:46:19.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:48:28.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:48:28.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:48:33.381 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:48:33.382 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:48:33.383 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:50:45.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:50:45.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:50:45.398 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:50:45.398 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:50:45.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:52:48.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:52:48.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:52:53.372 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:52:53.372 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:52:53.373 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:54:53.306 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T04:54:53.307 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T04:55:47.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:55:47.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:55:47.433 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:55:47.434 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:55:47.434 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T04:57:56.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T04:57:56.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T04:58:01.449 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T04:58:01.450 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T04:58:01.451 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:00:13.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:00:13.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:00:13.508 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:00:13.509 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:00:13.510 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:02:16.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:02:16.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:02:21.478 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:02:21.478 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:02:21.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:04:21.413 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T05:04:21.413 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T05:05:18.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:05:18.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:05:23.578 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:05:23.578 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:05:23.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:07:32.481 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:07:32.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:07:37.597 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:07:37.597 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:07:37.598 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:09:49.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:09:49.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:09:54.578 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:09:54.579 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:09:54.579 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:11:57.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:11:57.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:12:02.590 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:12:02.591 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:12:02.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:14:02.525 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T05:14:02.525 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T05:15:02.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:15:02.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:15:02.696 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:15:02.697 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:15:02.698 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:17:11.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:17:11.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:17:11.714 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:17:11.714 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:17:11.715 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:19:23.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:19:23.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:19:28.736 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:19:28.737 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:19:28.738 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:21:31.633 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:21:31.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:21:36.745 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:21:36.746 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:21:36.746 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:23:36.641 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T05:23:36.642 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T05:24:39.704 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:24:39.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:24:39.815 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:24:39.816 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:24:39.817 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:26:48.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:26:48.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:26:53.794 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:26:53.795 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:26:53.796 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:29:05.733 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:29:05.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:29:10.805 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:29:10.805 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:29:10.806 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:31:13.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:31:13.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:31:18.855 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:31:18.856 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:31:18.857 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:33:18.749 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T05:33:18.749 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T05:34:24.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:34:24.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:34:24.920 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:34:24.921 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:34:24.921 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:36:33.823 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:36:33.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:36:38.937 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:36:38.938 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:36:38.939 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:38:50.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:38:50.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:38:55.958 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:38:55.959 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:38:55.960 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:40:58.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:40:58.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:41:03.930 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:41:03.931 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:41:03.932 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:43:03.864 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T05:43:03.865 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T05:44:12.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:44:12.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:44:13.006 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:44:13.006 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:44:13.007 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:46:21.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:46:21.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:46:22.022 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:46:22.023 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:46:22.024 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:48:33.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:48:33.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:48:34.076 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:48:34.076 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:48:34.077 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:50:36.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:50:36.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:50:37.045 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:50:37.046 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:50:37.046 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:52:36.980 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T05:52:36.981 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T05:53:49.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:53:49.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:53:49.162 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:53:49.163 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:53:49.164 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:55:58.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:55:58.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:55:58.139 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:55:58.140 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:55:58.141 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T05:58:10.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T05:58:10.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T05:58:10.190 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T05:58:10.191 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T05:58:10.192 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:00:13.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:00:13.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:00:13.159 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:00:13.159 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:00:13.160 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:02:13.095 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T06:02:13.095 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T06:03:28.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:03:28.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:03:28.228 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:03:28.228 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:03:28.229 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:05:37.163 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:05:37.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:05:37.275 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:05:37.276 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:05:37.277 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:07:49.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:07:49.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:07:49.250 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:07:49.250 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:07:49.251 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:09:52.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:09:52.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:09:52.261 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:09:52.262 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:09:52.263 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:11:52.195 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T06:11:52.196 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T06:13:10.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:13:10.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:13:10.327 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:13:10.328 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:13:10.328 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:15:19.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:15:19.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:15:19.382 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:15:19.383 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:15:19.384 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:17:31.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:17:31.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:17:31.360 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:17:31.360 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:17:31.361 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:19:34.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:19:34.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:19:34.369 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:19:34.369 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:19:34.370 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:21:34.305 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T06:21:34.306 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T06:22:55.369 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:22:55.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:22:55.439 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:22:55.439 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:22:55.440 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:25:04.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:25:04.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:25:04.453 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:25:04.453 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:25:04.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:27:16.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:27:16.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:27:16.465 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:27:16.466 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:27:16.467 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:29:19.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:29:19.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:29:19.473 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:29:19.474 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:29:19.474 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:31:19.410 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T06:31:19.410 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T06:32:43.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:32:43.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:32:43.590 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:32:43.591 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:32:43.591 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:34:52.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:34:52.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:34:52.565 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:34:52.565 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:34:52.566 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:37:04.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:37:04.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:37:04.583 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:37:04.584 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:37:04.585 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:39:07.520 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:39:07.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:39:07.591 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:39:07.591 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:39:07.592 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:41:07.526 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T06:41:07.526 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T06:42:34.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:42:34.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:42:34.684 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:42:34.685 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:42:34.686 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:44:43.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:44:43.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:44:43.737 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:44:43.738 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:44:43.738 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:46:55.640 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:46:55.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:46:55.753 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:46:55.754 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:46:55.754 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:48:58.653 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:48:58.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:48:58.770 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:48:58.771 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:48:58.773 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:50:58.661 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T06:50:58.662 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T06:52:28.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:52:28.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:52:28.864 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:52:28.864 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:52:28.865 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:54:37.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:54:37.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:54:37.875 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:54:37.875 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:54:37.876 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:56:49.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:56:49.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:56:49.890 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:56:49.891 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:56:49.891 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T06:58:52.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T06:58:52.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T06:58:52.857 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T06:58:52.858 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T06:58:52.859 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:00:52.794 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T07:00:52.794 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T07:02:25.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:02:25.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:02:25.971 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:02:25.971 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:02:25.972 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:04:34.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:04:34.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:04:34.947 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:04:34.947 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:04:34.948 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:06:46.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:06:46.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:06:46.964 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:06:46.965 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:06:46.965 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:08:49.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:08:49.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:08:49.972 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:08:49.973 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:08:49.974 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:10:49.909 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T07:10:49.910 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T07:12:25.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:12:25.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:12:26.043 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:12:26.043 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:12:26.044 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:14:34.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:14:34.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:14:35.097 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:14:35.098 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:14:35.098 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:16:47.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:16:47.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:16:47.116 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:16:47.117 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:16:47.118 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:18:50.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:18:50.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:18:50.083 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:18:50.084 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:18:50.085 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:20:50.020 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T07:20:50.020 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T07:22:29.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:22:29.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:22:29.230 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:22:29.230 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:22:29.231 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:24:38.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:24:38.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:24:38.197 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:24:38.198 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:24:38.198 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:26:50.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:26:50.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:26:50.215 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:26:50.216 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:26:50.217 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:28:53.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:28:53.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:28:53.222 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:28:53.222 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:28:53.223 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:30:53.159 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T07:30:53.159 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T07:32:35.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:32:35.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:32:35.344 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:32:35.345 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:32:35.347 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:34:44.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:34:44.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:34:44.352 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:34:44.353 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:34:44.354 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:36:56.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:36:56.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:36:56.370 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:36:56.371 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:36:56.372 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:38:59.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:38:59.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:38:59.338 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:38:59.339 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:38:59.340 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:40:59.274 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T07:40:59.275 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T07:41:17.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:41:17.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:41:17.404 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:41:17.404 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:41:17.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:43:26.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:43:26.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:43:26.418 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:43:26.418 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:43:26.419 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:45:38.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:45:38.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:45:38.395 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:45:38.396 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:45:38.396 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:47:41.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-08-16T07:47:41.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T07:47:41.404 ERROR:teuthology.orchestra.connection:Error authenticating with smithi141.front.sepia.ceph.com: Authentication failed. 2023-08-16T07:47:41.404 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-08-16T07:47:41.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-16T07:49:41.340 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-08-16T07:49:41.340 ERROR:teuthology.provision.fog:Failed to reconnect to smithi141 on smithi141 2023-08-16T07:49:41.342 ERROR:teuthology.dispatcher.supervisor:Reimaging error. Nuking machines... Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 297, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'wait for sentinel on smithi141' reached maximum tries (35) after waiting for 1800 seconds 2023-08-16T07:49:41.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T07:49:41.512 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=206fd343a39942bfb1bc7ab1967998dd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 297, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'wait for sentinel on smithi141' reached maximum tries (35) after waiting for 1800 seconds 2023-08-16T07:49:41.515 INFO:teuthology.nuke:Checking targets against current locks 2023-08-16T07:49:41.572 DEBUG:teuthology.nuke:shortname: smithi049 2023-08-16T07:49:41.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T07:49:41.595 DEBUG:teuthology.nuke:shortname: smithi141 2023-08-16T07:49:41.596 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T07:49:41.598 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_18:58:56-rados-wip-yuri3-testing-2023-08-15-0955-distro-default-smithi/7369305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 02:32:58.381989', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUm0STXqRffRZcKnjfj3yvaBcPXKeoMyPdJKXKK43jwDGENkFBFFa3YI/CD80FTsc0P5YisebNP9Xtwjkpw4dM='} 2023-08-16T07:49:41.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-15_18:58:56-rados-wip-yuri3-testing-2023-08-15-0955-distro-default-smithi/7369305', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': '', 'os_version': '', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 02:32:58.380162', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5VLcVjSqJ/bpLT8N+WO1yiD049mK+EMnwrc/+pYS1FUtAUYgt8/3jh1CZ7RseB5UGFQj4F1r0K83mhL6Fi1G4I86elbvFS9lIMKlRKdE0zwSjSh9TtXnMdMr77nuDGECOqxK9b4/nvxDnuxX618gnco2fi0df/SKspjp0BGZN+GE/W+lZeQGXeQjnPiLSfDTZ3LlpJCXiPk+9LRPZw4nV0kHBcue4YwfDt4AZw3+M4/FGWbFIJe+mfu/TLgbHxmgwXuoodSES3Em3+JL/HPzUOJ0W0snJWM1HHGPB+SQQ5LUotAn3BS0blh5b7QamJIFHAYoLMqNvb3Edvf7JfrwgblKqp9zn9k13wnGlj26DlNb7NN57RxWI7/UC+ZTFFfA7MLwW/laeuUZrjv59sbwKyW5LOrQT+ObKcU/0A/gEgDMN/VXdyPTsTC82XtBM/9RT90S/AKBx9IZC8QuU/QhL+AAYQUBeT9nsPpQNrfpEgYtXCJjsbmcFDyIm5oYlvOM='} 2023-08-16T07:49:41.646 INFO:teuthology.orchestra.console.smithi049:Power off 2023-08-16T07:49:41.647 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T07:49:41.661 INFO:teuthology.orchestra.console.smithi141:Power off 2023-08-16T07:49:41.662 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-16T07:49:41.670 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-08-16T07:49:41.671 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:41.683 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-08-16T07:49:41.683 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:41.692 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-16T07:49:41.702 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-16T07:49:45.697 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:45.705 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:45.807 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-16T07:49:45.814 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-08-16T07:49:49.810 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:49.820 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:49.922 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-16T07:49:49.931 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-08-16T07:49:50.032 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-08-16T07:49:50.176 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com 2023-08-16T07:49:53.925 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-16T07:49:54.035 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-16T07:49:54.136 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-08-16T07:49:54.343 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-08-16T07:49:54.580 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/__init__.py", line 69, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 58, in main reimage(job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/dispatcher/supervisor.py", line 228, in reimage reimaged = lock_ops.reimage_machines(ctx, targets, job_config['machine_type']) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/lock/ops.py", line 325, in reimage_machines reimaged[machine] = machines[machine] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/__init__.py", line 44, in reimage result = obj.create() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 90, in create self._wait_for_ready() File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/provision/fog.py", line 297, in _wait_for_ready while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_54355694caed5e99f46f0c9317b1e9bcf8940415/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'wait for sentinel on smithi141' reached maximum tries (35) after waiting for 1800 seconds