2023-11-09T02:45:57.009 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T02:45:57.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:45:57.135 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f12861b8e50>, signals=[15]) 2023-11-09T02:45:57.136 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2023-11-09T02:45:57.137 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T02:45:57.137 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-11-09T02:45:57.158 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-11-09T02:45:57.158 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T02:45:57.158 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-09T02:45:57.160 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /host {"name": "smithi087"} 2023-11-09T02:45:57.183 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-11-09T02:45:57.239 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-09T02:45:57.252 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-11-09T02:45:57.282 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-09T02:45:57.282 DEBUG:teuthology.provision.fog.smithi087:FOG request: PUT /host/192 {"imageID": 2} 2023-11-09T02:45:57.298 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-11-09T02:45:57.299 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 2} 2023-11-09T02:45:57.329 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of ubuntu 20.04 2023-11-09T02:45:57.329 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:45:57.345 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 20.04 2023-11-09T02:45:57.345 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:45:57.406 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T02:45:57.416 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T02:45:57.444 DEBUG:teuthology.provision.fog.smithi087:FOG request: POST /host/192/task {"taskTypeID": 1} 2023-11-09T02:45:57.458 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-11-09T02:45:57.501 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:45:57.508 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:45:57.620 INFO:teuthology.orchestra.console.smithi087:Power off 2023-11-09T02:45:57.621 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T02:45:57.633 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-09T02:45:57.634 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T02:45:57.643 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-11-09T02:45:57.643 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:45:57.655 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-09T02:45:57.656 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:45:57.664 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-09T02:45:57.678 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-09T02:46:01.670 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:01.679 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:01.779 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-09T02:46:01.787 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-09T02:46:05.784 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:05.791 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:05.893 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-09T02:46:05.899 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-09T02:46:09.895 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:09.902 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:10.004 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-11-09T02:46:10.012 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-09T02:46:10.106 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-11-09T02:46:10.113 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-09T02:46:10.207 INFO:teuthology.orchestra.console.smithi087:Power on 2023-11-09T02:46:10.208 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T02:46:10.215 INFO:teuthology.orchestra.console.smithi148:Power on 2023-11-09T02:46:10.215 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T02:46:10.229 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2023-11-09T02:46:10.230 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:10.237 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-11-09T02:46:10.238 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:10.250 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-11-09T02:46:10.257 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-09T02:46:14.254 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:14.261 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:14.363 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-11-09T02:46:14.369 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-09T02:46:14.465 INFO:teuthology.orchestra.console.smithi087:Power on completed 2023-11-09T02:46:14.566 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2023-11-09T02:46:14.566 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:46:18.370 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T02:46:18.478 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-11-09T02:46:18.579 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-11-09T02:46:18.680 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-11-09T02:46:18.681 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:46:29.653 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:46:33.754 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:46:44.770 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:46:48.846 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:46:59.858 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:47:03.931 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:47:14.950 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:47:19.046 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:47:30.063 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:47:34.138 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:47:45.178 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:47:49.226 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:48:00.270 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:48:04.310 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:48:15.386 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:48:19.402 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:48:30.498 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:48:34.503 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:48:45.598 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:48:49.612 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:49:00.702 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:49:04.706 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:49:15.794 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:49:19.798 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:49:30.893 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:49:34.892 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:49:45.994 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:49:49.974 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:50:01.098 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-11-09T02:50:01.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:04.250 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:05.069 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-11-09T02:50:05.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:08.222 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:50:10.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:13.306 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:14.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:17.278 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:50:19.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:22.362 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:23.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:26.366 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:50:28.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:31.422 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:32.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:35.450 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:50:37.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:40.506 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:41.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:44.506 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:50:46.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:49.562 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:50.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:53.566 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:50:55.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:50:58.618 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-11-09T02:50:59.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:51:02.654 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-11-09T02:51:04.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:51:08.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:51:36.847 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T02:51:36.848 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T02:51:40.967 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T02:51:40.968 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T02:51:57.559 INFO:teuthology.provision.fog.smithi087:Node is ready 2023-11-09T02:51:57.560 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2023-11-09T02:51:57.567 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2023-11-09T02:51:57.567 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2023-11-09T02:51:57.614 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2023-11-09T02:51:57.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-11-09T02:51:57.696 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2023-11-09T02:51:57.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2023-11-09T02:51:57.772 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2023-11-09T02:51:57.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-11-09T02:51:57.841 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-11-09T02:51:57.848 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2023-11-09T02:51:57.848 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T02:51:57.849 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2023-11-09T02:51:57.849 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2023-11-09T02:51:57.849 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T02:51:57.849 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04" 2023-11-09T02:51:57.849 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T02:51:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T02:51:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T02:51:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T02:51:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal 2023-11-09T02:51:57.850 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal 2023-11-09T02:51:57.851 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2023-11-09T02:51:57.853 DEBUG:teuthology.parallel:result is None 2023-11-09T02:52:01.650 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-11-09T02:52:01.651 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-11-09T02:52:01.657 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-11-09T02:52:01.658 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-11-09T02:52:01.665 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-11-09T02:52:01.665 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-09T02:52:01.739 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-11-09T02:52:01.756 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-11-09T02:52:01.812 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-11-09T02:52:01.824 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-11-09T02:52:01.836 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-09T02:52:01.883 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-11-09T02:52:01.883 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T02:52:01.883 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-11-09T02:52:01.883 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-11-09T02:52:01.884 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T02:52:01.884 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2023-11-09T02:52:01.884 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T02:52:01.884 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T02:52:01.884 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T02:52:01.885 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T02:52:01.885 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2023-11-09T02:52:01.885 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2023-11-09T02:52:01.885 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-11-09T02:52:01.886 DEBUG:teuthology.parallel:result is None 2023-11-09T02:52:02.140 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2023-11-09T02:52:02.141 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T02:52:02.172 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-11-09T02:52:02.173 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-09T02:52:02.191 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2023-11-09T02:52:02.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-11-09T02:52:02.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:52:02.246 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-11-09T02:52:02.372 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-11-09T02:52:02.372 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-11-09T02:52:02.381 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-11-09T02:52:02.381 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-11-09T02:52:02.387 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2023-11-09T02:52:02.387 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T02:52:02.388 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2023-11-09T02:52:02.388 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2023-11-09T02:52:02.388 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T02:52:02.388 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04" 2023-11-09T02:52:02.388 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T02:52:02.389 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T02:52:02.389 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T02:52:02.389 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T02:52:02.390 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal 2023-11-09T02:52:02.390 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal 2023-11-09T02:52:02.390 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-11-09T02:52:02.414 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-11-09T02:52:02.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-09T02:52:02.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T02:52:02.463 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-11-09T02:52:02.587 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-11-09T02:52:02.588 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-11-09T02:52:02.594 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-11-09T02:52:02.595 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-11-09T02:52:02.599 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-11-09T02:52:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-09T02:52:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-11-09T02:52:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-11-09T02:52:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-09T02:52:02.600 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2023-11-09T02:52:02.601 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-09T02:52:02.601 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-09T02:52:02.601 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-09T02:52:02.601 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-09T02:52:02.601 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2023-11-09T02:52:02.602 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2023-11-09T02:52:02.602 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-11-09T02:52:02.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:52:02.718 INFO:teuthology.dispatcher.supervisor:Running job 7452358 2023-11-09T02:52:02.719 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452358 --name teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452358/orig.config.yaml 2023-11-09T02:52:02.722 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452358 2023-11-09T02:52:02.722 INFO:teuthology.dispatcher.supervisor:Job PID: 102856 2023-11-09T02:52:02.723 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T02:54:02.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:56:02.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T02:58:03.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:00:03.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:02:03.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:04:03.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T03:04:03.742 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T03:04:03.874 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-09T03:04:03.874 INFO:teuthology.nuke:Checking targets against current locks 2023-11-09T03:04:03.924 DEBUG:teuthology.nuke:shortname: smithi087 2023-11-09T03:04:03.925 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T03:04:03.944 DEBUG:teuthology.nuke:shortname: smithi148 2023-11-09T03:04:03.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T03:04:03.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452358', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 02:45:56.236061', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-09T03:04:03.971 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-09_02:25:01-upgrade:reef-x-main-distro-default-smithi/7452358', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 02:45:56.234070', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-09T03:04:03.994 INFO:teuthology.orchestra.console.smithi087:Power off 2023-11-09T03:04:03.995 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T03:04:04.020 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-11-09T03:04:04.021 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:04:04.035 INFO:teuthology.orchestra.console.smithi148:Power off 2023-11-09T03:04:04.035 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T03:04:04.044 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-11-09T03:04:04.056 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-11-09T03:04:04.057 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T03:04:04.078 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-11-09T03:04:04.147 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-11-09T03:04:04.179 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-11-09T03:04:04.310 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com 2023-11-09T03:04:04.324 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com