2023-10-10T10:42:14.626 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T10:42:14.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:42:14.796 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ef8312670>, signals=[15]) 2023-10-10T10:42:14.797 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-10-10T10:42:14.798 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T10:42:14.798 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-10T10:42:14.824 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2023-10-10T10:42:14.824 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T10:42:14.825 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-10T10:42:14.826 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /host {"name": "smithi083"} 2023-10-10T10:42:14.849 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /host {"name": "smithi163"} 2023-10-10T10:42:14.904 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-10T10:42:14.927 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-10T10:42:14.946 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-10T10:42:14.946 DEBUG:teuthology.provision.fog.smithi083:FOG request: PUT /host/188 {"imageID": 2} 2023-10-10T10:42:14.975 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-10T10:42:14.975 DEBUG:teuthology.provision.fog.smithi163:FOG request: PUT /host/268 {"imageID": 2} 2023-10-10T10:42:14.992 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04 2023-10-10T10:42:14.993 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:42:15.022 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of ubuntu 20.04 2023-10-10T10:42:15.022 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:42:15.052 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T10:42:15.076 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T10:42:15.089 DEBUG:teuthology.provision.fog.smithi083:FOG request: POST /host/188/task {"taskTypeID": 1} 2023-10-10T10:42:15.115 DEBUG:teuthology.provision.fog.smithi163:FOG request: POST /host/268/task {"taskTypeID": 1} 2023-10-10T10:42:15.143 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:42:15.179 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:42:15.242 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-10T10:42:15.243 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:42:15.270 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-10T10:42:15.271 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:15.293 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-10T10:42:15.293 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:42:15.307 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-10T10:42:15.322 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-10T10:42:15.322 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:15.347 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-10T10:42:19.310 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:19.348 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:19.422 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-10T10:42:19.460 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-10T10:42:23.426 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:23.461 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:23.542 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-10T10:42:23.573 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-10T10:42:23.644 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-10T10:42:23.675 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-10T10:42:23.745 INFO:teuthology.orchestra.console.smithi083:Power on 2023-10-10T10:42:23.746 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T10:42:23.766 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2023-10-10T10:42:23.766 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:23.776 INFO:teuthology.orchestra.console.smithi163:Power on 2023-10-10T10:42:23.777 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T10:42:23.791 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-10T10:42:23.803 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2023-10-10T10:42:23.804 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:23.826 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-10T10:42:27.794 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:27.827 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:27.905 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-10T10:42:27.938 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2023-10-10T10:42:28.039 INFO:teuthology.orchestra.console.smithi163:Power on completed 2023-10-10T10:42:28.141 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2023-10-10T10:42:28.141 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:42:31.910 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:42:32.021 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2023-10-10T10:42:32.122 INFO:teuthology.orchestra.console.smithi083:Power on completed 2023-10-10T10:42:32.223 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-10-10T10:42:32.223 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:42:43.222 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:42:47.307 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:42:58.314 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:43:02.382 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:43:13.394 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:43:17.462 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:43:28.482 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:43:32.550 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:43:43.562 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:43:47.622 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:43:58.646 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:44:02.690 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:44:13.734 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:44:17.754 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:44:28.810 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:44:32.828 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:44:43.890 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:44:47.906 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:44:58.976 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:45:02.966 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:45:14.042 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:45:18.030 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:45:29.114 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:45:33.090 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:45:44.182 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:45:48.158 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:45:59.250 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:46:03.210 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:46:14.314 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:46:18.267 DEBUG:teuthology.provision.fog.smithi083:FOG request: GET /task/active None 2023-10-10T10:46:18.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:46:29.382 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:46:36.666 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-10T10:46:42.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:46:44.433 DEBUG:teuthology.provision.fog.smithi163:FOG request: GET /task/active None 2023-10-10T10:46:44.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:46:45.726 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-10T10:46:51.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:46:54.810 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-10T10:47:00.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:03.034 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:47:03.866 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-10T10:47:09.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:09.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:12.122 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:47:18.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:21.210 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:47:27.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:28.382 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-10T10:47:30.302 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:47:34.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:36.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:37.466 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-10-10T10:47:39.386 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:47:43.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:44.165 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T10:47:44.166 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T10:47:45.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:48.442 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:47:54.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:47:57.498 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2023-10-10T10:48:03.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:48:04.844 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-10-10T10:48:04.844 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2023-10-10T10:48:04.851 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-10-10T10:48:04.851 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2023-10-10T10:48:04.859 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-10-10T10:48:04.859 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-10-10T10:48:04.952 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2023-10-10T10:48:04.967 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2023-10-10T10:48:04.978 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2023-10-10T10:48:04.993 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2023-10-10T10:48:05.050 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-10T10:48:05.056 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-10-10T10:48:05.057 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T10:48:05.057 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-10-10T10:48:05.057 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-10-10T10:48:05.057 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T10:48:05.057 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-10-10T10:48:05.058 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T10:48:05.058 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T10:48:05.058 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T10:48:05.058 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T10:48:05.058 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-10-10T10:48:05.059 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-10-10T10:48:05.059 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-10-10T10:48:05.061 DEBUG:teuthology.parallel:result is None 2023-10-10T10:48:35.634 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T10:48:35.635 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T10:48:57.121 INFO:teuthology.provision.fog.smithi163:Node is ready 2023-10-10T10:48:57.121 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2023-10-10T10:48:57.128 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2023-10-10T10:48:57.128 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2023-10-10T10:48:57.135 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2023-10-10T10:48:57.136 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-10T10:48:57.253 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2023-10-10T10:48:57.269 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2023-10-10T10:48:57.286 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2023-10-10T10:48:57.298 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2023-10-10T10:48:57.308 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-10T10:48:57.313 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-10-10T10:48:57.314 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T10:48:57.314 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-10-10T10:48:57.314 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-10-10T10:48:57.314 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T10:48:57.314 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2023-10-10T10:48:57.315 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T10:48:57.315 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T10:48:57.315 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T10:48:57.315 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T10:48:57.315 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2023-10-10T10:48:57.316 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2023-10-10T10:48:57.316 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2023-10-10T10:48:57.316 DEBUG:teuthology.parallel:result is None 2023-10-10T10:48:57.548 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-10-10T10:48:57.549 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T10:48:57.575 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2023-10-10T10:48:57.575 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T10:48:57.593 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-10-10T10:48:57.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-10T10:48:57.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:48:57.640 DEBUG:teuthology.orchestra.run.smithi083:> true 2023-10-10T10:48:57.843 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-10-10T10:48:57.844 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2023-10-10T10:48:57.850 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-10-10T10:48:57.851 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2023-10-10T10:48:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2023-10-10T10:48:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T10:48:57.899 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2023-10-10T10:48:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2023-10-10T10:48:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T10:48:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2023-10-10T10:48:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T10:48:57.900 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T10:48:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T10:48:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T10:48:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2023-10-10T10:48:57.901 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2023-10-10T10:48:57.902 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-10-10T10:48:57.925 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2023-10-10T10:48:57.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-10T10:48:57.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T10:48:57.974 DEBUG:teuthology.orchestra.run.smithi163:> true 2023-10-10T10:48:58.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2023-10-10T10:48:58.100 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2023-10-10T10:48:58.106 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2023-10-10T10:48:58.107 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2023-10-10T10:48:58.113 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="Ubuntu" 2023-10-10T10:48:58.113 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-10T10:48:58.113 INFO:teuthology.orchestra.run.smithi163.stdout:ID=ubuntu 2023-10-10T10:48:58.113 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE=debian 2023-10-10T10:48:58.113 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-10T10:48:58.114 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="20.04" 2023-10-10T10:48:58.114 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-10T10:48:58.114 INFO:teuthology.orchestra.run.smithi163.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-10T10:48:58.114 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-10T10:48:58.114 INFO:teuthology.orchestra.run.smithi163.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-10T10:48:58.114 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_CODENAME=focal 2023-10-10T10:48:58.115 INFO:teuthology.orchestra.run.smithi163.stdout:UBUNTU_CODENAME=focal 2023-10-10T10:48:58.115 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2023-10-10T10:48:58.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:48:58.213 INFO:teuthology.dispatcher.supervisor:Running job 7419547 2023-10-10T10:48:58.214 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419547 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419547/orig.config.yaml 2023-10-10T10:48:58.217 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419547 2023-10-10T10:48:58.218 INFO:teuthology.dispatcher.supervisor:Job PID: 1450208 2023-10-10T10:48:58.218 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T10:50:58.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:52:58.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:54:58.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:56:58.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:58:58.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:00:59.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:02:59.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:04:59.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T11:04:59.530 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T11:04:59.638 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T11:04:59.639 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T11:04:59.687 DEBUG:teuthology.nuke:shortname: smithi083 2023-10-10T11:04:59.688 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T11:04:59.701 DEBUG:teuthology.nuke:shortname: smithi163 2023-10-10T11:04:59.701 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T11:04:59.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 10:42:13.795556', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-10T11:04:59.723 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 10:42:13.797515', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-10T11:04:59.761 INFO:teuthology.orchestra.console.smithi083:Power off 2023-10-10T11:04:59.761 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:04:59.775 INFO:teuthology.orchestra.console.smithi163:Power off 2023-10-10T11:04:59.776 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T11:04:59.786 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2023-10-10T11:04:59.786 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:04:59.800 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2023-10-10T11:04:59.801 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T11:04:59.814 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2023-10-10T11:04:59.830 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2023-10-10T11:04:59.916 INFO:teuthology.orchestra.console.smithi083:Power off completed 2023-10-10T11:04:59.931 INFO:teuthology.orchestra.console.smithi163:Power off completed 2023-10-10T11:05:00.062 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-10-10T11:05:00.079 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com