2023-06-29T19:09:24.981 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-29T19:09:24.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:09:24.984 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:09:25.129 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f17c8d8d940>, signals=[15]) 2023-06-29T19:09:25.131 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-06-29T19:09:25.131 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:09:25.132 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-06-29T19:09:25.154 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-06-29T19:09:25.154 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-06-29T19:09:25.155 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-06-29T19:09:25.156 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-06-29T19:09:25.179 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /host {"name": "smithi137"} 2023-06-29T19:09:25.232 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-29T19:09:25.241 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-06-29T19:09:25.273 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-29T19:09:25.273 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 2} 2023-06-29T19:09:25.293 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-06-29T19:09:25.293 DEBUG:teuthology.provision.fog.smithi137:FOG request: PUT /host/242 {"imageID": 2} 2023-06-29T19:09:25.328 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of ubuntu 20.04 2023-06-29T19:09:25.328 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:09:25.336 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of ubuntu 20.04 2023-06-29T19:09:25.337 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:09:25.402 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:09:25.406 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /tasktype {"name": "deploy"} 2023-06-29T19:09:25.438 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-06-29T19:09:25.441 DEBUG:teuthology.provision.fog.smithi137:FOG request: POST /host/242/task {"taskTypeID": 1} 2023-06-29T19:09:25.496 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:09:25.504 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:09:25.609 INFO:teuthology.orchestra.console:Power off smithi137 2023-06-29T19:09:25.610 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:09:25.630 INFO:teuthology.orchestra.console:Power off smithi124 2023-06-29T19:09:25.630 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:09:25.642 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:25.654 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:29.670 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:29.687 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:33.786 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:33.799 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:37.900 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:37.911 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:38.113 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-06-29T19:09:38.124 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2023-06-29T19:09:38.215 INFO:teuthology.orchestra.console:Power on smithi137 2023-06-29T19:09:38.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:09:38.227 INFO:teuthology.orchestra.console:Power on smithi124 2023-06-29T19:09:38.227 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-06-29T19:09:38.237 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:38.250 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:42.264 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:42.275 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:09:42.475 INFO:teuthology.orchestra.console:Power on for smithi137 completed 2023-06-29T19:09:42.486 INFO:teuthology.orchestra.console:Power on for smithi124 completed 2023-06-29T19:09:42.577 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-06-29T19:09:42.578 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:09:42.588 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-06-29T19:09:42.588 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:09:57.676 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:09:57.677 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:10:12.772 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:10:12.773 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:10:27.868 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:10:27.869 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:10:42.984 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:10:42.985 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:10:58.077 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:10:58.079 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:11:13.180 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:11:13.181 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:11:28.265 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:11:28.266 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:11:43.356 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:11:43.357 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:11:58.443 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:11:58.444 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:12:13.524 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:12:13.525 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:12:28.620 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:12:28.621 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:12:43.696 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:12:43.698 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:12:58.777 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:12:58.778 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:13:13.848 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:13:13.850 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:13:28.932 DEBUG:teuthology.provision.fog.smithi137:FOG request: GET /task/active None 2023-06-29T19:13:28.933 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-06-29T19:13:28.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:28.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:32.048 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-06-29T19:13:32.049 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-06-29T19:13:38.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:38.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:41.108 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-06-29T19:13:41.109 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-06-29T19:13:47.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:47.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:50.192 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-06-29T19:13:50.193 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-06-29T19:13:56.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:56.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:13:59.280 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-06-29T19:13:59.281 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-06-29T19:14:05.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:14:05.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:14:08.340 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-06-29T19:14:08.372 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-06-29T19:14:14.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:14:14.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:14:17.424 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-06-29T19:14:23.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:15:14.427 WARNING:teuthology.provision.fog.smithi124:timed out 2023-06-29T19:15:20.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:15:20.572 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:15:20.574 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:15:21.047 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-06-29T19:15:21.048 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-06-29T19:15:21.054 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-06-29T19:15:21.055 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-06-29T19:15:21.061 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-06-29T19:15:21.061 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-06-29T19:15:21.193 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-06-29T19:15:21.209 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-06-29T19:15:21.224 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-06-29T19:15:21.234 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-06-29T19:15:21.243 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-06-29T19:15:21.290 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2023-06-29T19:15:21.290 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-29T19:15:21.290 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2023-06-29T19:15:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2023-06-29T19:15:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-29T19:15:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="20.04" 2023-06-29T19:15:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-29T19:15:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-29T19:15:21.291 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-29T19:15:21.292 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-29T19:15:21.292 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=focal 2023-06-29T19:15:21.292 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=focal 2023-06-29T19:15:21.292 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-06-29T19:15:21.294 DEBUG:teuthology.parallel:result is None 2023-06-29T19:15:23.432 WARNING:teuthology.provision.fog.smithi137:timed out 2023-06-29T19:15:29.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:15:29.576 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-29T19:15:29.576 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-06-29T19:15:30.092 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-06-29T19:15:30.092 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-06-29T19:15:30.101 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2023-06-29T19:15:30.102 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2023-06-29T19:15:30.108 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2023-06-29T19:15:30.109 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-06-29T19:15:30.205 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2023-06-29T19:15:30.221 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2023-06-29T19:15:30.279 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2023-06-29T19:15:30.290 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-06-29T19:15:30.300 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-06-29T19:15:30.349 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-29T19:15:30.350 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-29T19:15:30.351 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-29T19:15:30.351 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-29T19:15:30.351 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2023-06-29T19:15:30.351 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2023-06-29T19:15:30.351 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2023-06-29T19:15:30.352 DEBUG:teuthology.parallel:result is None 2023-06-29T19:15:30.633 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-06-29T19:15:30.634 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2023-06-29T19:15:30.634 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-29T19:15:30.670 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:15:30.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-06-29T19:15:30.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:15:30.727 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-06-29T19:15:30.850 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-06-29T19:15:30.857 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-06-29T19:15:30.858 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-06-29T19:15:30.864 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Ubuntu" 2023-06-29T19:15:30.865 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-29T19:15:30.865 INFO:teuthology.orchestra.run.smithi124.stdout:ID=ubuntu 2023-06-29T19:15:30.865 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE=debian 2023-06-29T19:15:30.865 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-29T19:15:30.865 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="20.04" 2023-06-29T19:15:30.865 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-29T19:15:30.866 INFO:teuthology.orchestra.run.smithi124.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-29T19:15:30.866 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-29T19:15:30.866 INFO:teuthology.orchestra.run.smithi124.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-29T19:15:30.866 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_CODENAME=focal 2023-06-29T19:15:30.866 INFO:teuthology.orchestra.run.smithi124.stdout:UBUNTU_CODENAME=focal 2023-06-29T19:15:30.866 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-06-29T19:15:30.886 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2023-06-29T19:15:30.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-06-29T19:15:30.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-29T19:15:30.941 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-06-29T19:15:31.065 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-06-29T19:15:31.072 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-06-29T19:15:31.072 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-06-29T19:15:31.078 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Ubuntu" 2023-06-29T19:15:31.079 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-29T19:15:31.079 INFO:teuthology.orchestra.run.smithi137.stdout:ID=ubuntu 2023-06-29T19:15:31.079 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE=debian 2023-06-29T19:15:31.079 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-29T19:15:31.079 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="20.04" 2023-06-29T19:15:31.079 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-29T19:15:31.080 INFO:teuthology.orchestra.run.smithi137.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-29T19:15:31.080 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-29T19:15:31.080 INFO:teuthology.orchestra.run.smithi137.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-29T19:15:31.080 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_CODENAME=focal 2023-06-29T19:15:31.080 INFO:teuthology.orchestra.run.smithi137.stdout:UBUNTU_CODENAME=focal 2023-06-29T19:15:31.081 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-06-29T19:15:31.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:15:31.103 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:15:31.190 INFO:teuthology.dispatcher.supervisor:Running job 7321505 2023-06-29T19:15:31.190 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e25bf390964c19fabac6a4bf8efd783aaa7f157c/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321505 --name adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} -- /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321505/orig.config.yaml 2023-06-29T19:15:31.194 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321505 2023-06-29T19:15:31.195 INFO:teuthology.dispatcher.supervisor:Job PID: 5118 2023-06-29T19:15:31.195 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-29T19:17:31.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:17:31.294 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:19:31.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:19:31.473 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:21:31.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:21:31.653 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:23:31.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:23:31.822 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:25:32.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:25:32.004 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:27:32.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:27:32.202 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:29:32.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:29:32.378 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:31:32.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:31:32.546 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:33:32.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:33:32.718 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:35:32.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:35:32.893 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:37:33.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:37:33.071 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:39:33.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:39:33.246 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:41:33.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:41:33.425 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:43:33.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:43:33.606 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:45:33.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:45:33.782 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:47:33.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:47:33.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:49:34.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:49:34.131 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:51:34.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:51:34.306 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:53:34.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:53:34.477 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:55:34.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-29T19:55:34.651 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-06-29T19:55:34.719 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-29T19:55:34.820 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-29T19:55:34.820 INFO:teuthology.nuke:Checking targets against current locks 2023-06-29T19:55:34.874 DEBUG:teuthology.nuke:shortname: smithi124 2023-06-29T19:55:34.875 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T19:55:34.901 DEBUG:teuthology.nuke:shortname: smithi137 2023-06-29T19:55:34.902 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-29T19:55:34.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321505', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:09:24.184069', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-29T19:55:34.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-06-29_13:57:59-orch:cephadm-wip-adk3-testing-2023-06-27-0854-distro-default-smithi/7321505', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-29 19:09:24.186401', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-29T19:55:34.960 INFO:teuthology.orchestra.console:Power off smithi124 2023-06-29T19:55:34.961 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:55:34.980 INFO:teuthology.orchestra.console:Power off smithi137 2023-06-29T19:55:34.981 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-29T19:55:34.991 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:55:35.004 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-29T19:55:35.115 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2023-06-29T19:55:35.126 INFO:teuthology.orchestra.console:Power off for smithi137 completed 2023-06-29T19:55:35.267 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2023-06-29T19:55:35.277 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com