2023-10-12T03:18:51.893 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T03:18:51.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:18:52.032 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f532a6bdf70>, signals=[15]) 2023-10-12T03:18:52.034 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-10-12T03:18:52.034 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T03:18:52.035 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-12T03:18:52.059 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-10-12T03:18:52.060 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T03:18:52.060 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-12T03:18:52.061 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-10-12T03:18:52.084 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /host {"name": "smithi190"} 2023-10-12T03:18:52.132 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-12T03:18:52.160 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-12T03:18:52.173 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-12T03:18:52.173 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 2} 2023-10-12T03:18:52.200 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-12T03:18:52.200 DEBUG:teuthology.provision.fog.smithi190:FOG request: PUT /host/295 {"imageID": 2} 2023-10-12T03:18:52.223 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 20.04 2023-10-12T03:18:52.223 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:18:52.253 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of ubuntu 20.04 2023-10-12T03:18:52.253 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:18:52.286 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T03:18:52.313 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T03:18:52.325 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-10-12T03:18:52.348 DEBUG:teuthology.provision.fog.smithi190:FOG request: POST /host/295/task {"taskTypeID": 1} 2023-10-12T03:18:52.390 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:18:52.415 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:18:52.490 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-12T03:18:52.491 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:18:52.505 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-12T03:18:52.506 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:18:52.515 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-12T03:18:52.516 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:18:52.527 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-12T03:18:52.528 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:18:52.535 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:18:52.549 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-12T03:18:52.636 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-12T03:18:52.651 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-12T03:18:52.737 INFO:teuthology.orchestra.console.smithi123:Power on 2023-10-12T03:18:52.738 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T03:18:52.753 INFO:teuthology.orchestra.console.smithi190:Power on 2023-10-12T03:18:52.754 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T03:18:52.762 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-10-12T03:18:52.763 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:18:52.775 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-10-12T03:18:52.776 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:18:52.784 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:18:52.799 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-12T03:18:56.789 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:18:56.800 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:18:56.899 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:18:56.908 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-10-12T03:18:57.008 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-10-12T03:18:57.109 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-10-12T03:18:57.110 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:19:00.903 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:19:01.012 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-10-12T03:19:01.113 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-10-12T03:19:01.214 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-10-12T03:19:01.215 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:19:12.194 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:19:16.282 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:19:27.291 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:19:31.360 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:19:42.375 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:19:46.438 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:19:57.465 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:20:01.538 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:20:12.554 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:20:16.614 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:20:27.654 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:20:31.690 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:20:42.722 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:20:46.750 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:20:57.790 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:21:01.818 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:21:12.870 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:21:16.886 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:21:27.950 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:21:31.950 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:21:43.054 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:21:47.023 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:21:58.139 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:22:02.096 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:22:13.214 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:22:17.166 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:22:28.290 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:22:32.235 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-10-12T03:22:32.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:22:32.613 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-12T03:22:43.357 DEBUG:teuthology.provision.fog.smithi190:FOG request: GET /task/active None 2023-10-12T03:22:43.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:23:01.882 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:23:07.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:23:10.938 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:23:16.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:23:19.998 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:23:25.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:23:29.050 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-10-12T03:23:35.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:23:36.617 WARNING:teuthology.provision.fog.smithi123:timed out 2023-10-12T03:23:42.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:24:01.018 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-10-12T03:24:07.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:24:08.331 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T03:24:08.332 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T03:24:29.508 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-10-12T03:24:29.508 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-10-12T03:24:29.514 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-10-12T03:24:29.514 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-10-12T03:24:29.520 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-10-12T03:24:29.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-12T03:24:29.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-10-12T03:24:29.651 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-10-12T03:24:29.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-10-12T03:24:29.678 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-10-12T03:24:29.734 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-12T03:24:29.741 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-10-12T03:24:29.741 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T03:24:29.741 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-10-12T03:24:29.741 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-10-12T03:24:29.742 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T03:24:29.742 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2023-10-12T03:24:29.742 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T03:24:29.742 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T03:24:29.743 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T03:24:29.743 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T03:24:29.743 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2023-10-12T03:24:29.743 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2023-10-12T03:24:29.744 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-10-12T03:24:29.745 DEBUG:teuthology.parallel:result is None 2023-10-12T03:24:35.054 WARNING:teuthology.provision.fog.smithi190:timed out 2023-10-12T03:24:41.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:24:41.210 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T03:24:41.210 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T03:24:41.707 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-10-12T03:24:41.708 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-10-12T03:24:41.714 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2023-10-12T03:24:41.715 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190.front.sepia.ceph.com /etc/hosts 2023-10-12T03:24:41.763 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-10-12T03:24:41.763 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-12T03:24:41.850 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hosts 2023-10-12T03:24:41.866 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-10-12T03:24:41.882 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190.front.sepia.ceph.com/smithi190/g' /etc/hostname 2023-10-12T03:24:41.899 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-10-12T03:24:41.908 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-12T03:24:41.913 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-10-12T03:24:41.913 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T03:24:41.913 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-10-12T03:24:41.913 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-10-12T03:24:41.913 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T03:24:41.914 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="20.04" 2023-10-12T03:24:41.914 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T03:24:41.914 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T03:24:41.914 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T03:24:41.914 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T03:24:41.915 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=focal 2023-10-12T03:24:41.915 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=focal 2023-10-12T03:24:41.915 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-10-12T03:24:41.916 DEBUG:teuthology.parallel:result is None 2023-10-12T03:24:42.142 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-10-12T03:24:42.143 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T03:24:42.172 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-10-12T03:24:42.172 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T03:24:42.198 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-10-12T03:24:42.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-12T03:24:42.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:24:42.251 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-10-12T03:24:42.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-10-12T03:24:42.376 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-10-12T03:24:42.382 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-10-12T03:24:42.383 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-10-12T03:24:42.431 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-10-12T03:24:42.431 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T03:24:42.431 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-10-12T03:24:42.432 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-10-12T03:24:42.432 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T03:24:42.432 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="20.04" 2023-10-12T03:24:42.432 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T03:24:42.432 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T03:24:42.433 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T03:24:42.433 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T03:24:42.433 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=focal 2023-10-12T03:24:42.433 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=focal 2023-10-12T03:24:42.434 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-10-12T03:24:42.455 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-10-12T03:24:42.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-12T03:24:42.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T03:24:42.506 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-10-12T03:24:42.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-10-12T03:24:42.629 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-10-12T03:24:42.679 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-10-12T03:24:42.679 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-10-12T03:24:42.686 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2023-10-12T03:24:42.686 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T03:24:42.686 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2023-10-12T03:24:42.686 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2023-10-12T03:24:42.687 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T03:24:42.687 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="20.04" 2023-10-12T03:24:42.687 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T03:24:42.687 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T03:24:42.687 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T03:24:42.688 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T03:24:42.688 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=focal 2023-10-12T03:24:42.688 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=focal 2023-10-12T03:24:42.689 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-10-12T03:24:42.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:24:42.808 INFO:teuthology.dispatcher.supervisor:Running job 7422458 2023-10-12T03:24:42.808 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422458 --name teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422458/orig.config.yaml 2023-10-12T03:24:42.812 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422458 2023-10-12T03:24:42.813 INFO:teuthology.dispatcher.supervisor:Job PID: 395524 2023-10-12T03:24:42.813 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-12T03:26:42.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:28:42.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:30:42.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:32:43.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:34:43.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:36:43.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T03:36:43.296 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-12T03:36:43.452 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-12T03:36:43.453 INFO:teuthology.nuke:Checking targets against current locks 2023-10-12T03:36:43.501 DEBUG:teuthology.nuke:shortname: smithi123 2023-10-12T03:36:43.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T03:36:43.518 DEBUG:teuthology.nuke:shortname: smithi190 2023-10-12T03:36:43.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T03:36:43.521 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 03:18:51.016484', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-12T03:36:43.546 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-12_02:25:02-upgrade:reef-x-main-distro-default-smithi/7422458', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 03:18:51.018149', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-12T03:36:43.568 INFO:teuthology.orchestra.console.smithi123:Power off 2023-10-12T03:36:43.569 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:36:43.592 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-10-12T03:36:43.593 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:43.607 INFO:teuthology.orchestra.console.smithi190:Power off 2023-10-12T03:36:43.608 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T03:36:43.617 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-10-12T03:36:43.628 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-10-12T03:36:43.629 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T03:36:43.649 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-10-12T03:36:43.718 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-10-12T03:36:43.750 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-10-12T03:36:43.873 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-10-12T03:36:43.895 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com