2023-10-09T06:30:24.048 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T06:30:24.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:30:24.226 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f284d96ff70>, signals=[15]) 2023-10-09T06:30:24.226 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2023-10-09T06:30:24.226 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2023-10-09T06:30:24.226 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-09T06:30:24.256 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-10-09T06:30:24.256 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-10-09T06:30:24.256 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-09T06:30:24.258 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /host {"name": "smithi148"} 2023-10-09T06:30:24.288 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-10-09T06:30:24.363 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-09T06:30:24.372 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-09T06:30:24.420 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-09T06:30:24.420 DEBUG:teuthology.provision.fog.smithi148:FOG request: PUT /host/253 {"imageID": 2} 2023-10-09T06:30:24.424 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-09T06:30:24.424 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 2} 2023-10-09T06:30:24.469 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of ubuntu 20.04 2023-10-09T06:30:24.469 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:30:24.476 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 20.04 2023-10-09T06:30:24.476 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:30:24.537 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /tasktype {"name": "deploy"} 2023-10-09T06:30:24.540 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-10-09T06:30:24.590 DEBUG:teuthology.provision.fog.smithi148:FOG request: POST /host/253/task {"taskTypeID": 1} 2023-10-09T06:30:24.595 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-10-09T06:30:24.671 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:30:24.696 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:30:24.773 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-09T06:30:24.773 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T06:30:24.790 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-09T06:30:24.791 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T06:30:24.811 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-09T06:30:24.811 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:24.824 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-09T06:30:24.826 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:24.842 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T06:30:24.854 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-09T06:30:24.943 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-09T06:30:24.954 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-09T06:30:25.045 INFO:teuthology.orchestra.console.smithi187:Power on 2023-10-09T06:30:25.045 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-09T06:30:25.055 INFO:teuthology.orchestra.console.smithi148:Power on 2023-10-09T06:30:25.055 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-09T06:30:25.081 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2023-10-09T06:30:25.082 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:25.094 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-10-09T06:30:25.095 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:25.110 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-09T06:30:25.138 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T06:30:29.114 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:29.139 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:29.223 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-09T06:30:29.249 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T06:30:33.226 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:33.250 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T06:30:33.335 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2023-10-09T06:30:33.436 INFO:teuthology.orchestra.console.smithi148:Power on completed 2023-10-09T06:30:33.463 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-10-09T06:30:33.537 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2023-10-09T06:30:33.537 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:30:33.564 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-10-09T06:30:33.665 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-10-09T06:30:33.665 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:30:48.618 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:30:48.725 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:31:03.698 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:31:03.784 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:31:18.780 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:31:18.847 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:31:33.866 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:31:33.900 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:31:48.934 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:31:48.958 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:32:04.034 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:32:04.035 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:32:19.106 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:32:19.107 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:32:34.194 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:32:34.196 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:32:49.270 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:32:49.272 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:33:04.354 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:33:04.355 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:33:19.426 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:33:19.427 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:33:34.502 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:33:34.504 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:33:49.575 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:33:49.576 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:34:04.666 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:34:04.667 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:34:19.747 DEBUG:teuthology.provision.fog.smithi148:FOG request: GET /task/active None 2023-10-09T06:34:19.749 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-10-09T06:34:19.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:34:19.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:34:38.330 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T06:34:38.331 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-09T06:34:44.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:34:44.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:34:47.386 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T06:34:47.386 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-09T06:34:53.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:34:53.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:34:56.446 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T06:34:56.447 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-09T06:35:02.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:35:02.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:35:05.534 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-10-09T06:35:05.535 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2023-10-09T06:35:11.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:35:11.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:35:43.789 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-09T06:35:43.790 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-09T06:36:05.169 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-10-09T06:36:05.169 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-10-09T06:36:05.176 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-10-09T06:36:05.176 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-10-09T06:36:05.183 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-10-09T06:36:05.183 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-09T06:36:05.260 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-10-09T06:36:05.276 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-10-09T06:36:05.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-10-09T06:36:05.304 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-10-09T06:36:05.315 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-09T06:36:05.319 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-10-09T06:36:05.319 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-09T06:36:05.319 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-10-09T06:36:05.319 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-10-09T06:36:05.319 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-09T06:36:05.319 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04" 2023-10-09T06:36:05.320 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-09T06:36:05.320 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-09T06:36:05.320 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-09T06:36:05.320 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-09T06:36:05.320 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal 2023-10-09T06:36:05.320 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal 2023-10-09T06:36:05.321 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-10-09T06:36:05.322 DEBUG:teuthology.parallel:result is None 2023-10-09T06:36:11.546 WARNING:teuthology.provision.fog.smithi148:timed out 2023-10-09T06:36:17.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:36:17.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-09T06:36:17.754 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-09T06:36:18.319 INFO:teuthology.provision.fog.smithi148:Node is ready 2023-10-09T06:36:18.320 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2023-10-09T06:36:18.326 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2023-10-09T06:36:18.326 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2023-10-09T06:36:18.373 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2023-10-09T06:36:18.374 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-09T06:36:18.482 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2023-10-09T06:36:18.497 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2023-10-09T06:36:18.512 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2023-10-09T06:36:18.571 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2023-10-09T06:36:18.580 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-09T06:36:18.585 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-10-09T06:36:18.585 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-09T06:36:18.586 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-09T06:36:18.587 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-09T06:36:18.587 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2023-10-09T06:36:18.587 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2023-10-09T06:36:18.587 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2023-10-09T06:36:18.588 DEBUG:teuthology.parallel:result is None 2023-10-09T06:36:18.822 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2023-10-09T06:36:18.822 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-09T06:36:18.841 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-10-09T06:36:18.841 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-09T06:36:18.864 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2023-10-09T06:36:18.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-09T06:36:18.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:36:18.911 DEBUG:teuthology.orchestra.run.smithi148:> true 2023-10-09T06:36:19.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2023-10-09T06:36:19.032 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2023-10-09T06:36:19.081 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2023-10-09T06:36:19.081 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2023-10-09T06:36:19.087 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2023-10-09T06:36:19.087 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-09T06:36:19.087 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2023-10-09T06:36:19.087 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="20.04" 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=focal 2023-10-09T06:36:19.088 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=focal 2023-10-09T06:36:19.088 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2023-10-09T06:36:19.116 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-10-09T06:36:19.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-09T06:36:19.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T06:36:19.172 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-10-09T06:36:19.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-10-09T06:36:19.380 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-10-09T06:36:19.429 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-10-09T06:36:19.429 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="20.04" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-09T06:36:19.435 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-09T06:36:19.436 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=focal 2023-10-09T06:36:19.436 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=focal 2023-10-09T06:36:19.436 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-10-09T06:36:19.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:36:19.553 INFO:teuthology.dispatcher.supervisor:Running job 7417528 2023-10-09T06:36:19.553 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417528 --name teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417528/orig.config.yaml 2023-10-09T06:36:19.556 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417528 2023-10-09T06:36:19.557 INFO:teuthology.dispatcher.supervisor:Job PID: 1450715 2023-10-09T06:36:19.557 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-09T06:38:19.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:40:19.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:42:20.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:44:20.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:46:20.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:48:20.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:50:20.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:52:20.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:54:21.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:56:21.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T06:58:21.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:00:21.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:02:21.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:04:21.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:06:22.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:08:22.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:10:22.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:12:22.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:14:22.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:16:22.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:18:23.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:20:23.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:22:23.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:24:23.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:26:23.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:28:23.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:30:24.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:32:24.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:34:24.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:36:24.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:38:24.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:40:24.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:42:25.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:44:25.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:46:25.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:48:25.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:50:25.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:52:25.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:54:25.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:56:26.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T07:58:26.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:00:26.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:02:26.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:04:26.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:06:26.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:08:27.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:10:27.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:12:27.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:14:27.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:16:27.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:18:27.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T08:18:28.031 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-09T08:18:28.236 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-09T08:18:28.236 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T08:18:28.287 DEBUG:teuthology.nuke:shortname: smithi148 2023-10-09T08:18:28.287 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T08:18:28.313 DEBUG:teuthology.nuke:shortname: smithi187 2023-10-09T08:18:28.313 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T08:18:28.314 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi148.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:30:23.157765', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-09T08:18:28.339 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-07_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7417528', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 06:30:23.156253', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-09T08:18:28.367 INFO:teuthology.orchestra.console.smithi148:Power off 2023-10-09T08:18:28.367 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T08:18:28.389 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2023-10-09T08:18:28.390 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:28.404 INFO:teuthology.orchestra.console.smithi187:Power off 2023-10-09T08:18:28.404 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T08:18:28.413 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2023-10-09T08:18:28.428 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-10-09T08:18:28.428 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T08:18:28.450 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-10-09T08:18:28.514 INFO:teuthology.orchestra.console.smithi148:Power off completed 2023-10-09T08:18:28.551 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-10-09T08:18:28.663 INFO:teuthology.lock.ops:unlocked: smithi148.front.sepia.ceph.com 2023-10-09T08:18:28.697 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com