2023-07-11T14:42:23.859 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T14:42:23.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:42:23.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:42:24.081 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9d1b7ecdc0>, signals=[15]) 2023-07-11T14:42:24.084 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging 2023-07-11T14:42:24.085 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T14:42:24.085 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-11T14:42:24.112 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-07-11T14:42:24.112 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-07-11T14:42:24.113 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-11T14:42:24.114 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"} 2023-07-11T14:42:24.138 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /host {"name": "smithi149"} 2023-07-11T14:42:24.195 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-11T14:42:24.202 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-07-11T14:42:24.239 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-11T14:42:24.240 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 2} 2023-07-11T14:42:24.242 DEBUG:teuthology.provision.fog.smithi149:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-07-11T14:42:24.243 DEBUG:teuthology.provision.fog.smithi149:FOG request: PUT /host/254 {"imageID": 2} 2023-07-11T14:42:24.281 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of ubuntu 20.04 2023-07-11T14:42:24.282 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:42:24.286 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 20.04 2023-07-11T14:42:24.286 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:42:24.349 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T14:42:24.352 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /tasktype {"name": "deploy"} 2023-07-11T14:42:24.389 DEBUG:teuthology.provision.fog.smithi149:FOG request: POST /host/254/task {"taskTypeID": 1} 2023-07-11T14:42:24.396 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1} 2023-07-11T14:42:24.437 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:42:24.454 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:42:24.524 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-11T14:42:24.525 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T14:42:24.548 INFO:teuthology.orchestra.console:Power off smithi092 2023-07-11T14:42:24.549 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T14:42:24.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:24.587 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:24.698 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-11T14:42:24.710 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-07-11T14:42:24.802 INFO:teuthology.orchestra.console:Power on smithi149 2023-07-11T14:42:24.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T14:42:24.816 INFO:teuthology.orchestra.console:Power on smithi092 2023-07-11T14:42:24.817 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-11T14:42:24.836 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:24.853 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:28.879 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:28.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:32.996 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:33.032 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T14:42:33.212 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-07-11T14:42:33.252 INFO:teuthology.orchestra.console:Power on for smithi092 completed 2023-07-11T14:42:33.314 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-07-11T14:42:33.314 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:42:33.354 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish 2023-07-11T14:42:33.354 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:42:48.392 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:42:48.415 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:43:03.472 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:43:03.474 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:43:18.548 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:43:18.549 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:43:33.620 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:43:33.622 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:43:48.696 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:43:48.697 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:44:03.780 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:44:03.783 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:44:18.871 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:44:18.872 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:44:33.948 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:44:33.949 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:44:49.027 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:44:49.030 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:45:04.125 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:45:04.127 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:45:19.207 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:45:19.208 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:45:34.287 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:45:34.289 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:45:49.368 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:45:49.370 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:46:04.440 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:46:04.442 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:46:19.524 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None 2023-07-11T14:46:19.525 DEBUG:teuthology.provision.fog.smithi149:FOG request: GET /task/active None 2023-07-11T14:46:19.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:19.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:22.676 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-11T14:46:22.677 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-11T14:46:28.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:28.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:31.760 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-11T14:46:31.761 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-11T14:46:37.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:37.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:40.816 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-11T14:46:40.817 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-11T14:46:46.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:46.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:49.876 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-11T14:46:49.877 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-11T14:46:55.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:55.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:46:58.960 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-11T14:46:58.961 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92 2023-07-11T14:47:04.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:47:04.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:47:08.016 WARNING:teuthology.provision.fog.smithi149:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-07-11T14:47:14.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:48:05.018 WARNING:teuthology.provision.fog.smithi092:timed out 2023-07-11T14:48:11.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:48:11.231 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:48:11.232 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:48:11.687 INFO:teuthology.provision.fog.smithi092:Node is ready 2023-07-11T14:48:11.688 DEBUG:teuthology.orchestra.run.smithi092:> hostname 2023-07-11T14:48:11.695 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com 2023-07-11T14:48:11.696 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts 2023-07-11T14:48:11.703 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092 2023-07-11T14:48:11.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-07-11T14:48:11.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts 2023-07-11T14:48:11.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts 2023-07-11T14:48:11.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname 2023-07-11T14:48:11.867 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092 2023-07-11T14:48:11.878 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-11T14:48:11.926 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Ubuntu" 2023-07-11T14:48:11.926 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:48:11.926 INFO:teuthology.orchestra.run.smithi092.stdout:ID=ubuntu 2023-07-11T14:48:11.926 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE=debian 2023-07-11T14:48:11.927 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:48:11.927 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="20.04" 2023-07-11T14:48:11.927 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:48:11.927 INFO:teuthology.orchestra.run.smithi092.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:48:11.927 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:48:11.927 INFO:teuthology.orchestra.run.smithi092.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:48:11.928 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_CODENAME=focal 2023-07-11T14:48:11.928 INFO:teuthology.orchestra.run.smithi092.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:48:11.928 INFO:teuthology.provision.fog.smithi092:Deploy complete! 2023-07-11T14:48:11.930 DEBUG:teuthology.parallel:result is None 2023-07-11T14:48:14.024 WARNING:teuthology.provision.fog.smithi149:timed out 2023-07-11T14:48:20.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:48:20.243 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-11T14:48:20.244 DEBUG:teuthology.orchestra.run.smithi149:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-11T14:48:20.758 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-07-11T14:48:20.758 DEBUG:teuthology.orchestra.run.smithi149:> hostname 2023-07-11T14:48:20.807 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-07-11T14:48:20.808 DEBUG:teuthology.orchestra.run.smithi149:> grep smithi149.front.sepia.ceph.com /etc/hosts 2023-07-11T14:48:20.814 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-07-11T14:48:20.815 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-11T14:48:20.896 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hosts 2023-07-11T14:48:20.912 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/172.21.15.149/172.21.15.149/g' /etc/hosts 2023-07-11T14:48:20.971 DEBUG:teuthology.orchestra.run.smithi149:> sudo sed -i -e 's/smithi149.front.sepia.ceph.com/smithi149/g' /etc/hostname 2023-07-11T14:48:20.986 DEBUG:teuthology.orchestra.run.smithi149:> sudo hostname smithi149 2023-07-11T14:48:20.999 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-11T14:48:21.005 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-07-11T14:48:21.005 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:48:21.005 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-07-11T14:48:21.006 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-07-11T14:48:21.006 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:48:21.006 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-07-11T14:48:21.006 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:48:21.007 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:48:21.007 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:48:21.007 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:48:21.009 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-07-11T14:48:21.009 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:48:21.010 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-07-11T14:48:21.010 DEBUG:teuthology.parallel:result is None 2023-07-11T14:48:21.240 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com 2023-07-11T14:48:21.241 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T14:48:21.268 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-07-11T14:48:21.269 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-11T14:48:21.294 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server 2023-07-11T14:48:21.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-11T14:48:21.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:48:21.352 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-11T14:48:21.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-11T14:48:21.471 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-07-11T14:48:21.478 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-07-11T14:48:21.479 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-11T14:48:21.485 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Ubuntu" 2023-07-11T14:48:21.485 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:48:21.485 INFO:teuthology.orchestra.run.smithi092.stdout:ID=ubuntu 2023-07-11T14:48:21.485 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE=debian 2023-07-11T14:48:21.486 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:48:21.486 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="20.04" 2023-07-11T14:48:21.486 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:48:21.486 INFO:teuthology.orchestra.run.smithi092.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:48:21.487 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:48:21.487 INFO:teuthology.orchestra.run.smithi092.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:48:21.487 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_CODENAME=focal 2023-07-11T14:48:21.487 INFO:teuthology.orchestra.run.smithi092.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:48:21.488 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-11T14:48:21.518 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-07-11T14:48:21.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-11T14:48:21.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi149.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-11T14:48:21.574 DEBUG:teuthology.orchestra.run.smithi149:> true 2023-07-11T14:48:21.695 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-07-11T14:48:21.695 DEBUG:teuthology.orchestra.run.smithi149:> uname -m 2023-07-11T14:48:21.702 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-07-11T14:48:21.703 DEBUG:teuthology.orchestra.run.smithi149:> cat /etc/os-release 2023-07-11T14:48:21.710 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-07-11T14:48:21.710 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-11T14:48:21.711 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-07-11T14:48:21.711 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-07-11T14:48:21.711 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-11T14:48:21.712 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-07-11T14:48:21.712 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-11T14:48:21.712 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-11T14:48:21.713 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-11T14:48:21.714 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-11T14:48:21.714 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-07-11T14:48:21.714 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-07-11T14:48:21.715 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-07-11T14:48:21.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:48:21.744 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:48:21.849 INFO:teuthology.dispatcher.supervisor:Running job 7333885 2023-07-11T14:48:21.849 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333885 --name yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi --description orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} -- /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333885/orig.config.yaml 2023-07-11T14:48:21.853 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333885 2023-07-11T14:48:21.854 INFO:teuthology.dispatcher.supervisor:Job PID: 23312 2023-07-11T14:48:21.855 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-11T14:50:21.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:50:21.953 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:52:22.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:52:22.212 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:54:22.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:54:22.390 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:56:22.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:56:22.566 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T14:58:22.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T14:58:22.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:00:22.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:00:22.967 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:02:23.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:02:23.141 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:04:23.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:04:23.310 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:06:23.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:06:23.414 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:08:23.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:08:23.582 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:10:23.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:10:23.717 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:12:23.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:12:23.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:14:23.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:14:23.975 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:16:24.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:16:24.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:18:24.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:18:24.329 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:20:24.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:20:24.486 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:22:24.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:22:24.594 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:24:24.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:24:24.763 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:26:24.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:26:24.932 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:28:25.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:28:25.017 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:30:25.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:30:25.101 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:32:25.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:32:25.180 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:34:25.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:34:25.348 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:36:25.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:36:25.545 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:38:25.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:38:25.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:40:25.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:40:25.826 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:42:26.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:42:26.011 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:44:26.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:44:26.185 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:46:26.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:46:26.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:48:26.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-11T15:48:26.535 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-11T15:48:26.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-11T15:48:26.719 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-11T15:48:26.719 INFO:teuthology.nuke:Checking targets against current locks 2023-07-11T15:48:26.768 DEBUG:teuthology.nuke:shortname: smithi092 2023-07-11T15:48:26.769 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T15:48:26.787 DEBUG:teuthology.nuke:shortname: smithi149 2023-07-11T15:48:26.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-11T15:48:26.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 14:42:22.680292', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-07-11T15:48:26.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi149.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-11_14:31:27-orch-wip-yuri8-testing-2023-07-06-0909-reef-distro-default-smithi/7333885', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 14:42:22.678154', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-11T15:48:26.844 INFO:teuthology.orchestra.console:Power off smithi092 2023-07-11T15:48:26.845 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T15:48:26.857 INFO:teuthology.orchestra.console:Power off smithi149 2023-07-11T15:48:26.858 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-11T15:48:26.867 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T15:48:26.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi149.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-11T15:48:26.987 INFO:teuthology.orchestra.console:Power off for smithi092 completed 2023-07-11T15:48:26.995 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-07-11T15:48:27.137 INFO:teuthology.lock.ops:unlocked: smithi092.front.sepia.ceph.com 2023-07-11T15:48:27.145 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com