2023-07-11T14:50:28.762 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T14:50:28.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:50:28.764 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:50:28.909 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1e3be1df70>, signals=[15]) 2023-07-11T14:50:28.911 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-07-11T14:50:28.911 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T14:50:28.911 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-07-11T14:50:28.936 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-07-11T14:50:28.936 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T14:50:28.936 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-11T14:50:28.938 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /host {"name": "smithi053"} 2023-07-11T14:50:28.961 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-07-11T14:50:29.017 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-11T14:50:29.033 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-11T14:50:29.058 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-11T14:50:29.059 DEBUG:teuthology.provision.fog.smithi053:FOG request: PUT /host/158 {"imageID": 2} 2023-07-11T14:50:29.084 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-11T14:50:29.084 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 2} 2023-07-11T14:50:29.106 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of ubuntu 20.04 2023-07-11T14:50:29.106 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:50:29.128 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of ubuntu 20.04 2023-07-11T14:50:29.129 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:50:29.165 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T14:50:29.190 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T14:50:29.206 DEBUG:teuthology.provision.fog.smithi053:FOG request: POST /host/158/task {"taskTypeID": 1} 2023-07-11T14:50:29.227 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-07-11T14:50:29.279 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:50:29.307 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:50:29.377 INFO:teuthology.orchestra.console:Power off smithi053 2023-07-11T14:50:29.378 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T14:50:29.400 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:29.419 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-11T14:50:29.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T14:50:29.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:29.530 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-07-11T14:50:29.566 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-11T14:50:29.632 INFO:teuthology.orchestra.console:Power on smithi053 2023-07-11T14:50:29.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T14:50:29.654 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:29.667 INFO:teuthology.orchestra.console:Power on smithi102 2023-07-11T14:50:29.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T14:50:29.690 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:33.681 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:33.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:33.924 INFO:teuthology.orchestra.console:Power on for smithi102 completed 2023-07-11T14:50:34.025 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-07-11T14:50:34.026 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:50:37.796 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:50:38.006 INFO:teuthology.orchestra.console:Power on for smithi053 completed 2023-07-11T14:50:38.107 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-07-11T14:50:38.107 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:50:49.112 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:50:53.172 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:51:04.184 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:51:08.257 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:51:19.256 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:51:23.327 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:51:34.348 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:51:38.392 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:51:49.428 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:51:53.464 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:52:04.516 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:52:08.528 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:52:19.600 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:52:23.604 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:52:34.686 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:52:38.700 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:52:49.796 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:52:53.788 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:53:04.910 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:53:08.872 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:53:20.008 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:53:23.944 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:53:35.110 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:53:39.036 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:53:50.208 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:53:54.112 DEBUG:teuthology.provision.fog.smithi053:FOG request: GET /task/active None 2023-07-11T14:53:54.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:53:54.611 ERROR:teuthology.orchestra.connection:Error authenticating with smithi053.front.sepia.ceph.com: Authentication failed. 2023-07-11T14:53:54.613 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:53:54.614 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:53:54.617 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-11T14:54:05.291 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:54:20.368 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-11T14:54:20.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:23.508 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:54:29.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:32.564 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:54:38.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:41.616 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:54:47.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:50.672 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:54:56.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:54:59.728 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:55:05.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:08.784 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:55:14.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:17.844 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:55:23.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:42.196 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:55:48.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:51.252 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-11T14:55:57.040 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-11T14:55:57.042 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi053 2023-07-11T14:55:57.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:55:57.929 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:55:57.929 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:56:06.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-11T14:56:06.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:06.261 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-07-11T14:56:06.753 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-11T14:56:06.753 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:56:06.754 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:56:06.760 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-07-11T14:56:06.760 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-07-11T14:56:06.812 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-07-11T14:56:06.813 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-07-11T14:56:06.819 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-07-11T14:56:06.819 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-07-11T14:56:06.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-07-11T14:56:06.909 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-07-11T14:56:06.920 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-07-11T14:56:06.935 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-07-11T14:56:06.946 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-07-11T14:56:06.952 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2023-07-11T14:56:06.952 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:56:06.953 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2023-07-11T14:56:06.953 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2023-07-11T14:56:06.953 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:56:06.953 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="20.04" 2023-07-11T14:56:06.953 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:56:06.953 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:56:06.954 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:56:06.954 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:56:06.954 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=focal 2023-07-11T14:56:06.954 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:56:06.955 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-07-11T14:56:06.956 DEBUG:teuthology.parallel:result is None 2023-07-11T14:56:18.793 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-07-11T14:56:18.793 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-07-11T14:56:18.800 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-07-11T14:56:18.801 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-07-11T14:56:18.848 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-07-11T14:56:18.848 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-11T14:56:18.928 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-07-11T14:56:18.945 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-07-11T14:56:19.005 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-07-11T14:56:19.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-11T14:56:19.026 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-11T14:56:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-07-11T14:56:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:56:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-07-11T14:56:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-07-11T14:56:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:56:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2023-07-11T14:56:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:56:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:56:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:56:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:56:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2023-07-11T14:56:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:56:19.034 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-07-11T14:56:19.035 DEBUG:teuthology.parallel:result is None 2023-07-11T14:56:19.276 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-07-11T14:56:19.277 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T14:56:19.303 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-07-11T14:56:19.304 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T14:56:19.321 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-07-11T14:56:19.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-11T14:56:19.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:19.373 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-07-11T14:56:19.573 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-07-11T14:56:19.574 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-07-11T14:56:19.621 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-07-11T14:56:19.621 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-07-11T14:56:19.627 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2023-07-11T14:56:19.628 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:56:19.628 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2023-07-11T14:56:19.628 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2023-07-11T14:56:19.628 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:56:19.628 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="20.04" 2023-07-11T14:56:19.628 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:56:19.629 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:56:19.629 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:56:19.629 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:56:19.629 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=focal 2023-07-11T14:56:19.629 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:56:19.630 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-07-11T14:56:19.653 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-07-11T14:56:19.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-11T14:56:19.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:56:19.703 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-07-11T14:56:19.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-11T14:56:19.822 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-07-11T14:56:19.828 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-07-11T14:56:19.829 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-07-11T14:56:19.834 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:56:19.835 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:56:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:56:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:56:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2023-07-11T14:56:19.836 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:56:19.836 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-11T14:56:19.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:56:19.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:56:19.967 INFO:teuthology.dispatcher.supervisor:Running job 7333894 2023-07-11T14:56:19.967 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333894 --name yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333894/orig.config.yaml 2023-07-11T14:56:19.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333894 2023-07-11T14:56:19.972 INFO:teuthology.dispatcher.supervisor:Job PID: 1986 2023-07-11T14:56:19.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-11T14:58:20.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:58:20.074 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:00:20.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:00:20.250 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:02:20.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:02:20.422 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:04:20.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:04:20.597 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:06:20.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:06:20.786 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:08:20.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:08:20.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:10:21.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:10:21.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:12:21.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:12:21.288 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:14:21.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:14:21.438 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:16:21.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:16:21.517 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:18:21.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:18:21.657 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:20:21.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:20:21.799 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:22:21.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:22:21.968 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:24:22.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:24:22.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:26:22.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:26:22.254 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:28:22.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:28:22.387 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:30:22.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:30:22.562 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:32:22.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:32:22.640 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:34:22.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:34:22.810 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:36:22.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:36:22.974 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:36:23.053 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-11T15:36:23.148 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-11T15:36:23.149 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T15:36:23.197 DEBUG:teuthology.nuke:shortname: smithi053 2023-07-11T15:36:23.198 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T15:36:23.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 14:50:27.960843', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-11T15:36:23.225 DEBUG:teuthology.nuke:shortname: smithi102 2023-07-11T15:36:23.225 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T15:36:23.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333894', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 14:50:27.963116', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-11T15:36:23.265 INFO:teuthology.orchestra.console:Power off smithi053 2023-07-11T15:36:23.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T15:36:23.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T15:36:23.307 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-11T15:36:23.308 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T15:36:23.328 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T15:36:23.418 INFO:teuthology.orchestra.console:Power off for smithi053 completed 2023-07-11T15:36:23.450 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-11T15:36:23.577 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-07-11T15:36:23.601 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com