2023-07-26T11:26:09.945 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T11:26:09.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:26:09.947 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:26:10.104 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc808f6b1f0>, signals=[15]) 2023-07-26T11:26:10.106 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-07-26T11:26:10.108 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T11:26:10.108 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-26T11:26:10.133 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-07-26T11:26:10.134 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T11:26:10.134 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-26T11:26:10.135 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-07-26T11:26:10.158 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-07-26T11:26:10.212 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-26T11:26:10.232 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-26T11:26:10.250 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-26T11:26:10.250 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 2} 2023-07-26T11:26:10.276 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-26T11:26:10.277 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 2} 2023-07-26T11:26:10.295 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of ubuntu 20.04 2023-07-26T11:26:10.296 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:26:10.342 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of ubuntu 20.04 2023-07-26T11:26:10.342 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:26:10.362 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T11:26:10.392 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T11:26:10.394 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-07-26T11:26:10.429 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-07-26T11:26:10.470 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:26:10.476 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:26:10.565 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-26T11:26:10.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T11:26:10.584 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-26T11:26:10.584 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T11:26:10.594 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T11:26:10.595 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:10.606 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T11:26:10.607 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:10.620 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T11:26:10.629 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T11:26:10.721 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-26T11:26:10.822 INFO:teuthology.orchestra.console:Power on smithi090 2023-07-26T11:26:10.822 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T11:26:10.843 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T11:26:10.844 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:10.866 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T11:26:14.632 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:14.743 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T11:26:14.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:14.976 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T11:26:15.077 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-07-26T11:26:15.178 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-07-26T11:26:15.179 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:26:18.747 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:18.856 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T11:26:22.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:22.971 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T11:26:23.072 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-26T11:26:23.173 INFO:teuthology.orchestra.console:Power on smithi102 2023-07-26T11:26:23.173 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T11:26:23.192 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T11:26:23.193 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:23.212 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T11:26:27.216 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:26:27.326 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T11:26:27.427 INFO:teuthology.orchestra.console:Power on for smithi102 completed 2023-07-26T11:26:27.527 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-07-26T11:26:27.528 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:26:30.240 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:26:42.601 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:26:45.300 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:26:57.680 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:27:00.364 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:27:12.760 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:27:15.427 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:27:27.828 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:27:30.488 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:27:42.900 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:27:45.563 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:27:57.974 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:28:00.624 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:28:13.036 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:28:15.698 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:28:28.133 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:28:30.771 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:28:43.210 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:28:45.840 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:28:58.293 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:29:00.907 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:29:13.357 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:29:15.972 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:29:28.426 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:29:31.042 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:29:43.502 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:29:46.105 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:29:58.564 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:30:01.186 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:30:13.619 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-07-26T11:30:13.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:30:16.258 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:30:31.325 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:30:32.176 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-26T11:30:38.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:30:41.264 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-26T11:30:46.380 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T11:30:46.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:30:47.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:30:49.520 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:30:50.320 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-26T11:30:55.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:30:56.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:30:58.576 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:30:59.376 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-26T11:31:04.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:05.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:07.632 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:31:13.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:16.688 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:31:22.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:23.892 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-26T11:31:25.744 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:31:29.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:31.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:32.976 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-07-26T11:31:34.800 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:31:38.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:39.681 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T11:31:39.682 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T11:31:40.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:43.856 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:31:49.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:31:52.912 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:31:58.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:32:00.603 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-07-26T11:32:00.604 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-07-26T11:32:00.610 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-07-26T11:32:00.611 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-07-26T11:32:00.661 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-07-26T11:32:00.661 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-26T11:32:00.847 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-07-26T11:32:00.865 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-07-26T11:32:00.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-07-26T11:32:00.892 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-07-26T11:32:00.952 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-26T11:32:00.956 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T11:32:00.957 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T11:32:00.958 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T11:32:00.958 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T11:32:00.958 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2023-07-26T11:32:00.958 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2023-07-26T11:32:00.959 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-07-26T11:32:00.960 DEBUG:teuthology.parallel:result is None 2023-07-26T11:32:01.968 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T11:32:07.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:32:41.131 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T11:32:41.132 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T11:33:03.719 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-07-26T11:33:03.719 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-07-26T11:33:03.726 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-07-26T11:33:03.726 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-07-26T11:33:03.733 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-07-26T11:33:03.733 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-26T11:33:03.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-07-26T11:33:03.889 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-07-26T11:33:03.903 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-07-26T11:33:03.918 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-26T11:33:03.930 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2023-07-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-26T11:33:03.935 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2023-07-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2023-07-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="20.04" 2023-07-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T11:33:03.936 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=focal 2023-07-26T11:33:03.937 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=focal 2023-07-26T11:33:03.937 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-07-26T11:33:03.938 DEBUG:teuthology.parallel:result is None 2023-07-26T11:33:04.182 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-07-26T11:33:04.183 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T11:33:04.213 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-07-26T11:33:04.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T11:33:04.240 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-07-26T11:33:04.240 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-26T11:33:04.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:33:04.288 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-26T11:33:04.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-26T11:33:04.410 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-07-26T11:33:04.416 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-07-26T11:33:04.416 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-26T11:33:04.423 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="Ubuntu" 2023-07-26T11:33:04.423 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-26T11:33:04.423 INFO:teuthology.orchestra.run.smithi090.stdout:ID=ubuntu 2023-07-26T11:33:04.423 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE=debian 2023-07-26T11:33:04.423 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-26T11:33:04.423 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="20.04" 2023-07-26T11:33:04.424 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T11:33:04.424 INFO:teuthology.orchestra.run.smithi090.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T11:33:04.424 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T11:33:04.424 INFO:teuthology.orchestra.run.smithi090.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T11:33:04.424 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_CODENAME=focal 2023-07-26T11:33:04.424 INFO:teuthology.orchestra.run.smithi090.stdout:UBUNTU_CODENAME=focal 2023-07-26T11:33:04.425 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-26T11:33:04.447 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-07-26T11:33:04.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-26T11:33:04.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T11:33:04.498 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-07-26T11:33:04.706 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-07-26T11:33:04.706 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-07-26T11:33:04.712 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-07-26T11:33:04.713 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-07-26T11:33:04.718 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2023-07-26T11:33:04.718 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-26T11:33:04.719 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2023-07-26T11:33:04.719 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2023-07-26T11:33:04.719 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-26T11:33:04.719 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="20.04" 2023-07-26T11:33:04.719 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-26T11:33:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-26T11:33:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-26T11:33:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-26T11:33:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=focal 2023-07-26T11:33:04.720 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=focal 2023-07-26T11:33:04.721 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-07-26T11:33:04.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:33:04.748 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:33:04.897 INFO:teuthology.dispatcher.supervisor:Running job 7352853 2023-07-26T11:33:04.897 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853 --name gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} -- /home/teuthworker/archive/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853/orig.config.yaml 2023-07-26T11:33:04.901 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853 2023-07-26T11:33:04.901 INFO:teuthology.dispatcher.supervisor:Job PID: 12472 2023-07-26T11:33:04.902 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T11:35:04.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:35:04.996 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:37:05.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:37:05.177 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:39:05.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:39:05.351 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:41:05.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:41:05.521 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:43:05.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:43:05.692 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:45:05.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:45:05.864 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:47:06.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:47:06.038 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:49:06.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:49:06.205 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:51:06.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:51:06.376 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:53:06.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:53:06.549 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:55:06.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:55:06.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:57:06.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:57:06.882 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:59:07.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:59:07.046 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:01:07.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:01:07.225 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:03:07.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:03:07.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:05:07.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:05:07.530 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:07:07.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:07:07.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:09:07.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:09:07.867 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:11:08.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:11:08.037 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:13:08.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:13:08.229 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:15:08.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T12:15:08.405 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T12:15:08.473 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T12:15:08.569 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T12:15:08.570 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T12:15:08.625 DEBUG:teuthology.nuke:shortname: smithi090 2023-07-26T12:15:08.626 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T12:15:08.654 DEBUG:teuthology.nuke:shortname: smithi102 2023-07-26T12:15:08.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T12:15:08.655 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 11:26:09.169401', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-26T12:15:08.675 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_11:17:09-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352853', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 11:26:09.170980', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-26T12:15:08.706 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-26T12:15:08.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T12:15:08.729 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T12:15:08.729 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T12:15:08.746 INFO:teuthology.orchestra.console:Power off smithi102 2023-07-26T12:15:08.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T12:15:08.758 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T12:15:08.770 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T12:15:08.770 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T12:15:08.792 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T12:15:08.861 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-26T12:15:08.893 INFO:teuthology.orchestra.console:Power off for smithi102 completed 2023-07-26T12:15:09.024 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-07-26T12:15:09.038 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com