2023-10-21T16:40:26.793 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-21T16:40:26.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:40:26.929 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa7c0fb1e50>, signals=[15]) 2023-10-21T16:40:26.931 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2023-10-21T16:40:26.931 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T16:40:26.931 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-21T16:40:26.955 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2023-10-21T16:40:26.956 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T16:40:26.956 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-21T16:40:26.958 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"} 2023-10-21T16:40:26.980 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"} 2023-10-21T16:40:27.028 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T16:40:27.052 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-21T16:40:27.066 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T16:40:27.066 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 2} 2023-10-21T16:40:27.095 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-21T16:40:27.095 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 2} 2023-10-21T16:40:27.114 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of ubuntu 20.04 2023-10-21T16:40:27.114 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:40:27.134 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of ubuntu 20.04 2023-10-21T16:40:27.134 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:40:27.186 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T16:40:27.190 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T16:40:27.224 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1} 2023-10-21T16:40:27.235 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1} 2023-10-21T16:40:27.275 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:40:27.293 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:40:27.381 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-21T16:40:27.382 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T16:40:27.393 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-21T16:40:27.394 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T16:40:27.402 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-21T16:40:27.403 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:27.416 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-21T16:40:27.416 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:27.424 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-21T16:40:27.438 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-21T16:40:31.426 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:31.438 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:31.536 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-21T16:40:31.547 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-21T16:40:35.538 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:35.548 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:35.647 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-21T16:40:35.657 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T16:40:35.758 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-21T16:40:35.859 INFO:teuthology.orchestra.console.smithi057:Power on 2023-10-21T16:40:35.859 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T16:40:35.879 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2023-10-21T16:40:35.879 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:35.930 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T16:40:39.650 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:39.759 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-21T16:40:39.860 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-21T16:40:39.932 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:39.961 INFO:teuthology.orchestra.console.smithi136:Power on 2023-10-21T16:40:39.962 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T16:40:39.983 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2023-10-21T16:40:39.983 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:40.002 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-21T16:40:40.041 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T16:40:44.006 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:44.042 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T16:40:44.117 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2023-10-21T16:40:44.151 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2023-10-21T16:40:44.218 INFO:teuthology.orchestra.console.smithi136:Power on completed 2023-10-21T16:40:44.252 INFO:teuthology.orchestra.console.smithi057:Power on completed 2023-10-21T16:40:44.319 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2023-10-21T16:40:44.320 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:40:44.353 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2023-10-21T16:40:44.354 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:40:59.398 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:40:59.414 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:41:14.499 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:41:14.500 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:41:29.586 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:41:29.588 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:41:44.666 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:41:44.668 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:41:59.750 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:41:59.752 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:42:14.830 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:42:14.832 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:42:29.910 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:42:29.916 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:42:45.002 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:42:45.004 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:43:00.094 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:43:00.096 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:43:15.184 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:43:15.185 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:43:30.290 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:43:30.292 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:43:45.362 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:43:45.364 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:44:00.434 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:44:00.436 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:44:15.500 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:44:15.502 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:44:30.575 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None 2023-10-21T16:44:30.577 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None 2023-10-21T16:44:30.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:44:30.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:44:49.150 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T16:44:49.151 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:44:55.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:44:55.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:44:58.234 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T16:44:58.235 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:45:04.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:04.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:07.290 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T16:45:07.291 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:45:13.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:13.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:16.378 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2023-10-21T16:45:16.379 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:45:22.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:22.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:25.438 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:45:31.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:37.562 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:45:43.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:46.618 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:45:52.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:45:55.706 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2023-10-21T16:46:01.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:46:02.411 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T16:46:02.412 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T16:46:22.385 WARNING:teuthology.provision.fog.smithi057:timed out 2023-10-21T16:46:23.245 INFO:teuthology.provision.fog.smithi136:Node is ready 2023-10-21T16:46:23.245 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2023-10-21T16:46:23.252 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2023-10-21T16:46:23.252 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2023-10-21T16:46:23.260 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2023-10-21T16:46:23.260 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-10-21T16:46:23.351 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2023-10-21T16:46:23.368 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2023-10-21T16:46:23.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2023-10-21T16:46:23.439 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2023-10-21T16:46:23.450 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-21T16:46:23.500 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2023-10-21T16:46:23.501 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T16:46:23.501 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2023-10-21T16:46:23.501 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2023-10-21T16:46:23.501 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T16:46:23.502 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04" 2023-10-21T16:46:23.502 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T16:46:23.502 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T16:46:23.502 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T16:46:23.503 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T16:46:23.503 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal 2023-10-21T16:46:23.503 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal 2023-10-21T16:46:23.504 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2023-10-21T16:46:23.505 DEBUG:teuthology.parallel:result is None 2023-10-21T16:46:28.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:46:28.595 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T16:46:28.596 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T16:46:29.155 INFO:teuthology.provision.fog.smithi057:Node is ready 2023-10-21T16:46:29.155 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2023-10-21T16:46:29.161 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2023-10-21T16:46:29.162 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2023-10-21T16:46:29.213 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2023-10-21T16:46:29.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-21T16:46:29.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2023-10-21T16:46:29.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2023-10-21T16:46:29.383 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2023-10-21T16:46:29.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2023-10-21T16:46:29.415 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-21T16:46:29.422 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-10-21T16:46:29.422 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T16:46:29.422 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-10-21T16:46:29.423 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-10-21T16:46:29.423 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T16:46:29.423 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-10-21T16:46:29.423 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T16:46:29.423 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T16:46:29.424 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T16:46:29.424 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T16:46:29.424 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-10-21T16:46:29.424 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-10-21T16:46:29.425 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2023-10-21T16:46:29.425 DEBUG:teuthology.parallel:result is None 2023-10-21T16:46:29.656 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2023-10-21T16:46:29.657 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T16:46:29.676 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2023-10-21T16:46:29.677 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T16:46:29.694 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2023-10-21T16:46:29.695 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-21T16:46:29.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:46:29.746 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-10-21T16:46:29.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-10-21T16:46:29.868 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-10-21T16:46:29.875 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-10-21T16:46:29.875 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-10-21T16:46:29.882 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Ubuntu" 2023-10-21T16:46:29.882 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T16:46:29.882 INFO:teuthology.orchestra.run.smithi057.stdout:ID=ubuntu 2023-10-21T16:46:29.883 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE=debian 2023-10-21T16:46:29.883 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T16:46:29.883 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="20.04" 2023-10-21T16:46:29.883 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T16:46:29.883 INFO:teuthology.orchestra.run.smithi057.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T16:46:29.884 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T16:46:29.884 INFO:teuthology.orchestra.run.smithi057.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T16:46:29.884 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_CODENAME=focal 2023-10-21T16:46:29.884 INFO:teuthology.orchestra.run.smithi057.stdout:UBUNTU_CODENAME=focal 2023-10-21T16:46:29.884 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-10-21T16:46:29.910 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2023-10-21T16:46:29.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-21T16:46:29.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T16:46:29.960 DEBUG:teuthology.orchestra.run.smithi136:> true 2023-10-21T16:46:30.080 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2023-10-21T16:46:30.080 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2023-10-21T16:46:30.086 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2023-10-21T16:46:30.087 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2023-10-21T16:46:30.093 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Ubuntu" 2023-10-21T16:46:30.093 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-21T16:46:30.094 INFO:teuthology.orchestra.run.smithi136.stdout:ID=ubuntu 2023-10-21T16:46:30.094 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE=debian 2023-10-21T16:46:30.094 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-21T16:46:30.094 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="20.04" 2023-10-21T16:46:30.094 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-21T16:46:30.095 INFO:teuthology.orchestra.run.smithi136.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-21T16:46:30.095 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-21T16:46:30.095 INFO:teuthology.orchestra.run.smithi136.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-21T16:46:30.095 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_CODENAME=focal 2023-10-21T16:46:30.095 INFO:teuthology.orchestra.run.smithi136.stdout:UBUNTU_CODENAME=focal 2023-10-21T16:46:30.096 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2023-10-21T16:46:30.118 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:46:30.204 INFO:teuthology.dispatcher.supervisor:Running job 7427682 2023-10-21T16:46:30.204 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427682 --name teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi --description upgrade:quincy-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427682/orig.config.yaml 2023-10-21T16:46:30.207 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427682 2023-10-21T16:46:30.208 INFO:teuthology.dispatcher.supervisor:Job PID: 3865290 2023-10-21T16:46:30.208 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T16:48:30.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:50:30.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:52:30.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:54:30.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:56:30.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T16:58:31.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:00:31.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:02:31.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:04:31.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:06:31.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:08:31.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:10:32.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:12:32.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:14:32.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:16:32.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:18:32.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:20:32.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:22:33.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:24:33.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:26:33.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:28:33.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:30:33.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:32:33.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:34:34.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:36:34.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:38:34.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:40:34.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:42:34.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:44:34.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:46:35.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:48:35.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:50:35.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:52:35.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:54:35.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:56:35.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:58:35.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:00:36.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:02:36.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:04:36.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:06:36.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:08:36.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:10:36.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:12:37.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:14:37.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:16:37.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:18:37.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:18:37.651 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T18:18:37.847 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T18:18:37.848 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T18:18:37.897 DEBUG:teuthology.nuke:shortname: smithi057 2023-10-21T18:18:37.898 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T18:18:37.920 DEBUG:teuthology.nuke:shortname: smithi136 2023-10-21T18:18:37.920 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T18:18:37.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 16:40:25.922051', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T18:18:37.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:quincy-x-reef-distro-default-smithi/7427682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 16:40:25.920513', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-21T18:18:37.977 INFO:teuthology.orchestra.console.smithi057:Power off 2023-10-21T18:18:37.977 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:18:37.998 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2023-10-21T18:18:37.999 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:18:38.014 INFO:teuthology.orchestra.console.smithi136:Power off 2023-10-21T18:18:38.015 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T18:18:38.023 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2023-10-21T18:18:38.036 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2023-10-21T18:18:38.036 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T18:18:38.078 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2023-10-21T18:18:38.125 INFO:teuthology.orchestra.console.smithi057:Power off completed 2023-10-21T18:18:38.180 INFO:teuthology.orchestra.console.smithi136:Power off completed 2023-10-21T18:18:38.272 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2023-10-21T18:18:38.331 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com