2023-10-18T19:20:02.670 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-18T19:20:02.672 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:20:02.824 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f791fb9d670>, signals=[15]) 2023-10-18T19:20:02.825 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-10-18T19:20:02.826 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T19:20:02.826 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-18T19:20:02.852 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-10-18T19:20:02.853 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T19:20:02.853 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-18T19:20:02.854 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-10-18T19:20:02.877 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-10-18T19:20:02.925 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-18T19:20:02.941 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-18T19:20:02.960 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-18T19:20:02.961 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 2} 2023-10-18T19:20:02.987 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-18T19:20:02.988 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 2} 2023-10-18T19:20:03.011 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of ubuntu 20.04 2023-10-18T19:20:03.012 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:20:03.040 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 20.04 2023-10-18T19:20:03.040 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:20:03.059 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T19:20:03.087 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T19:20:03.094 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-10-18T19:20:03.124 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-10-18T19:20:03.165 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:20:03.189 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:20:03.259 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-18T19:20:03.260 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T19:20:03.272 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-18T19:20:03.273 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T19:20:03.282 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-18T19:20:03.282 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:03.295 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-18T19:20:03.295 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:03.305 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T19:20:03.320 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-18T19:20:07.310 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:07.321 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:07.420 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T19:20:07.431 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-18T19:20:11.422 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:11.432 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:11.532 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-18T19:20:11.540 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-18T19:20:11.634 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-18T19:20:11.641 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-18T19:20:11.735 INFO:teuthology.orchestra.console.smithi059:Power on 2023-10-18T19:20:11.736 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T19:20:11.746 INFO:teuthology.orchestra.console.smithi153:Power on 2023-10-18T19:20:11.747 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T19:20:11.767 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-10-18T19:20:11.767 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:11.776 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-10-18T19:20:11.777 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:11.788 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-18T19:20:11.798 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-18T19:20:15.790 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:15.800 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:15.902 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-18T19:20:15.908 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-18T19:20:19.906 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:19.913 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:20:20.016 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-18T19:20:20.022 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-18T19:20:20.117 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-10-18T19:20:20.123 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-10-18T19:20:20.219 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-10-18T19:20:20.219 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:20:20.225 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-10-18T19:20:20.225 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:20:35.302 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:20:35.304 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:20:50.390 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:20:50.392 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:21:05.476 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:21:05.477 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:21:20.556 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:21:20.563 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:21:35.642 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:21:35.644 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:21:50.738 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:21:50.742 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:22:05.815 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:22:05.817 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:22:20.898 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:22:20.900 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:22:35.990 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:22:35.992 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:22:51.071 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:22:51.072 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:23:06.159 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:23:06.161 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:23:21.258 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:23:21.260 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:23:36.346 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:23:36.348 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:23:51.442 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-18T19:23:51.444 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:23:51.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:06.530 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-18T19:24:06.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:09.984 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T19:24:15.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:19.066 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T19:24:25.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:25.082 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-18T19:24:28.122 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T19:24:31.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:34.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:34.138 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-18T19:24:37.178 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-18T19:24:40.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:43.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:43.194 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-18T19:24:49.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:24:52.253 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-18T19:24:58.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:25:01.338 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-18T19:25:07.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:25:10.395 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-18T19:25:16.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:25:43.210 WARNING:teuthology.provision.fog.smithi059:timed out 2023-10-18T19:25:49.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:25:49.435 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T19:25:49.437 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T19:25:49.936 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-10-18T19:25:49.937 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-10-18T19:25:49.943 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-10-18T19:25:49.944 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-10-18T19:25:49.991 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-10-18T19:25:49.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-18T19:25:50.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-10-18T19:25:50.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-10-18T19:25:50.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-10-18T19:25:50.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-18T19:25:50.186 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-18T19:25:50.193 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2023-10-18T19:25:50.193 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T19:25:50.194 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2023-10-18T19:25:50.194 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2023-10-18T19:25:50.194 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T19:25:50.194 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="20.04" 2023-10-18T19:25:50.195 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T19:25:50.195 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T19:25:50.195 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T19:25:50.195 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T19:25:50.196 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=focal 2023-10-18T19:25:50.196 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=focal 2023-10-18T19:25:50.197 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-10-18T19:25:50.198 DEBUG:teuthology.parallel:result is None 2023-10-18T19:26:16.431 WARNING:teuthology.provision.fog.smithi153:timed out 2023-10-18T19:26:22.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:26:22.643 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T19:26:22.644 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T19:26:23.125 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-10-18T19:26:23.126 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-10-18T19:26:23.133 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-10-18T19:26:23.133 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-10-18T19:26:23.140 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-10-18T19:26:23.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-10-18T19:26:23.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-10-18T19:26:23.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-10-18T19:26:23.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-10-18T19:26:23.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-10-18T19:26:23.328 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-18T19:26:23.333 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-10-18T19:26:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T19:26:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-10-18T19:26:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-10-18T19:26:23.334 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T19:26:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2023-10-18T19:26:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T19:26:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T19:26:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T19:26:23.335 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T19:26:23.336 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2023-10-18T19:26:23.336 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2023-10-18T19:26:23.336 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-10-18T19:26:23.337 DEBUG:teuthology.parallel:result is None 2023-10-18T19:26:23.602 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-10-18T19:26:23.603 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T19:26:23.622 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-10-18T19:26:23.622 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T19:26:23.648 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-10-18T19:26:23.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-18T19:26:23.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:26:23.699 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-18T19:26:23.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-18T19:26:23.904 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-18T19:26:23.911 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-18T19:26:23.912 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-18T19:26:23.918 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2023-10-18T19:26:23.919 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T19:26:23.919 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2023-10-18T19:26:23.919 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2023-10-18T19:26:23.919 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T19:26:23.920 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="20.04" 2023-10-18T19:26:23.920 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T19:26:23.920 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T19:26:23.920 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T19:26:23.920 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T19:26:23.921 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=focal 2023-10-18T19:26:23.921 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=focal 2023-10-18T19:26:23.921 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-18T19:26:23.947 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-10-18T19:26:23.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-18T19:26:23.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T19:26:23.998 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-18T19:26:24.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-18T19:26:24.120 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-18T19:26:24.127 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-18T19:26:24.127 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-18T19:26:24.131 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-10-18T19:26:24.132 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-18T19:26:24.132 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-10-18T19:26:24.132 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-10-18T19:26:24.132 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-18T19:26:24.133 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2023-10-18T19:26:24.133 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-18T19:26:24.133 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-18T19:26:24.133 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-18T19:26:24.133 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-18T19:26:24.134 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2023-10-18T19:26:24.134 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2023-10-18T19:26:24.134 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-18T19:26:24.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:26:24.236 INFO:teuthology.dispatcher.supervisor:Running job 7429228 2023-10-18T19:26:24.237 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429228 --name vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi --description fs/volumes/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429228/orig.config.yaml 2023-10-18T19:26:24.240 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429228 2023-10-18T19:26:24.241 INFO:teuthology.dispatcher.supervisor:Job PID: 2658565 2023-10-18T19:26:24.241 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T19:28:24.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:30:24.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:32:24.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:34:24.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:36:24.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:38:25.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:40:25.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:42:25.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:44:25.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:46:25.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:48:25.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T19:48:26.055 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T19:48:26.199 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-18T19:48:26.199 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T19:48:26.247 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-18T19:48:26.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T19:48:26.270 DEBUG:teuthology.nuke:shortname: smithi153 2023-10-18T19:48:26.270 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T19:48:26.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 19:20:01.803741', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-18T19:48:26.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-16_12:48:28-fs-wip-vshankar-testing-pacific-20231016.091648-testing-default-smithi/7429228', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 19:20:01.802099', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-18T19:48:26.325 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-18T19:48:26.326 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T19:48:26.345 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-18T19:48:26.345 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T19:48:26.355 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-18T19:48:26.356 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:48:26.366 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-18T19:48:26.367 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T19:48:26.376 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-18T19:48:26.387 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-18T19:48:26.478 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-18T19:48:26.489 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-18T19:48:26.629 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-10-18T19:48:26.637 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com