2023-10-12T19:37:16.899 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-12T19:37:16.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:37:17.038 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f44714ab670>, signals=[15]) 2023-10-12T19:37:17.040 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-12T19:37:17.040 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T19:37:17.040 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-12T19:37:17.060 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging 2023-10-12T19:37:17.060 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server 2023-10-12T19:37:17.061 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-12T19:37:17.062 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-12T19:37:17.085 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /host {"name": "smithi194"} 2023-10-12T19:37:17.143 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-12T19:37:17.151 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /image {"name": "smithi_ubuntu_20.04"} 2023-10-12T19:37:17.197 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-12T19:37:17.198 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 2} 2023-10-12T19:37:17.201 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_ubuntu_20.04 (ID 2) 2023-10-12T19:37:17.201 DEBUG:teuthology.provision.fog.smithi194:FOG request: PUT /host/299 {"imageID": 2} 2023-10-12T19:37:17.261 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of ubuntu 20.04 2023-10-12T19:37:17.261 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:37:17.265 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 20.04 2023-10-12T19:37:17.265 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:37:17.314 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T19:37:17.318 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /tasktype {"name": "deploy"} 2023-10-12T19:37:17.355 DEBUG:teuthology.provision.fog.smithi194:FOG request: POST /host/299/task {"taskTypeID": 1} 2023-10-12T19:37:17.358 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-12T19:37:17.410 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:37:17.434 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:37:17.496 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-12T19:37:17.497 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T19:37:17.519 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-12T19:37:17.520 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:17.537 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-12T19:37:17.537 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T19:37:17.546 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-12T19:37:17.559 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-12T19:37:17.559 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:17.585 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-12T19:37:17.648 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-12T19:37:17.687 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-12T19:37:17.749 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-12T19:37:17.750 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T19:37:17.770 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-12T19:37:17.771 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:17.788 INFO:teuthology.orchestra.console.smithi194:Power on 2023-10-12T19:37:17.789 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-12T19:37:17.797 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-12T19:37:17.810 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On 2023-10-12T19:37:17.811 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:17.835 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-12T19:37:21.802 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:21.836 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:21.911 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-12T19:37:21.945 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-12T19:37:22.012 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-12T19:37:22.113 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-12T19:37:22.113 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:37:25.946 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T19:37:26.055 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2023-10-12T19:37:26.156 INFO:teuthology.orchestra.console.smithi194:Power on completed 2023-10-12T19:37:26.257 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2023-10-12T19:37:26.257 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:37:37.191 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:37:41.321 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:37:52.286 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:37:56.400 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:38:07.370 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:38:11.478 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:38:22.450 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:38:26.554 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:38:37.526 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:38:41.638 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:38:52.610 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:38:56.710 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:39:07.694 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:39:11.782 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:39:22.778 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:39:26.842 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:39:37.859 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:39:41.910 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:39:52.938 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:39:56.998 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:40:08.019 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:40:12.074 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:40:23.102 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:40:27.154 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:40:38.178 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:40:42.218 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:40:53.250 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:40:57.282 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:41:08.318 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-12T19:41:08.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:12.346 DEBUG:teuthology.provision.fog.smithi194:FOG request: GET /task/active None 2023-10-12T19:41:12.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:26.782 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-12T19:41:30.874 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-12T19:41:32.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:35.870 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-12T19:41:36.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:39.934 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-12T19:41:41.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:44.954 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-12T19:41:45.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:49.018 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-12T19:41:50.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:54.010 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-12T19:41:55.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:41:58.074 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-12T19:42:00.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:42:04.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:42:22.590 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-12T19:42:28.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:42:31.674 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194 2023-10-12T19:42:32.786 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T19:42:32.788 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T19:42:37.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:42:38.025 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-12T19:42:38.026 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-12T19:42:54.148 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-12T19:42:54.149 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-12T19:42:54.156 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-12T19:42:54.156 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-12T19:42:54.204 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-12T19:42:54.204 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-12T19:42:54.291 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-12T19:42:54.308 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-12T19:42:54.365 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-12T19:42:54.376 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-12T19:42:54.390 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-12T19:42:54.435 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-10-12T19:42:54.436 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T19:42:54.436 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-10-12T19:42:54.436 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-10-12T19:42:54.436 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T19:42:54.437 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2023-10-12T19:42:54.437 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T19:42:54.437 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T19:42:54.437 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T19:42:54.437 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T19:42:54.438 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2023-10-12T19:42:54.438 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2023-10-12T19:42:54.439 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-12T19:42:54.440 DEBUG:teuthology.parallel:result is None 2023-10-12T19:42:58.887 INFO:teuthology.provision.fog.smithi194:Node is ready 2023-10-12T19:42:58.888 DEBUG:teuthology.orchestra.run.smithi194:> hostname 2023-10-12T19:42:58.895 INFO:teuthology.orchestra.run.smithi194.stdout:smithi129 2023-10-12T19:42:58.895 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi129 /etc/hosts 2023-10-12T19:42:58.902 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.129 smithi129 smithi129 2023-10-12T19:42:58.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-12T19:42:58.967 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi129/smithi194/g' /etc/hosts 2023-10-12T19:42:58.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.129/172.21.15.194/g' /etc/hosts 2023-10-12T19:42:58.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi129/smithi194/g' /etc/hostname 2023-10-12T19:42:59.011 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194 2023-10-12T19:42:59.021 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-12T19:42:59.028 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2023-10-12T19:42:59.028 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T19:42:59.028 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2023-10-12T19:42:59.028 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2023-10-12T19:42:59.029 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T19:42:59.029 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="20.04" 2023-10-12T19:42:59.029 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T19:42:59.029 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T19:42:59.029 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T19:42:59.030 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T19:42:59.030 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=focal 2023-10-12T19:42:59.030 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=focal 2023-10-12T19:42:59.030 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2023-10-12T19:42:59.031 DEBUG:teuthology.parallel:result is None 2023-10-12T19:42:59.238 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-10-12T19:42:59.239 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T19:42:59.268 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2023-10-12T19:42:59.268 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-12T19:42:59.286 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-10-12T19:42:59.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-12T19:42:59.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:42:59.335 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-12T19:42:59.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-12T19:42:59.456 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-12T19:42:59.462 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-12T19:42:59.463 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-12T19:42:59.469 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2023-10-12T19:42:59.469 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T19:42:59.470 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2023-10-12T19:42:59.470 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2023-10-12T19:42:59.470 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T19:42:59.470 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="20.04" 2023-10-12T19:42:59.471 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T19:42:59.471 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T19:42:59.471 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T19:42:59.472 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T19:42:59.472 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=focal 2023-10-12T19:42:59.472 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=focal 2023-10-12T19:42:59.472 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-12T19:42:59.493 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2023-10-12T19:42:59.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-12T19:42:59.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-12T19:42:59.538 DEBUG:teuthology.orchestra.run.smithi194:> true 2023-10-12T19:42:59.655 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2023-10-12T19:42:59.656 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2023-10-12T19:42:59.662 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2023-10-12T19:42:59.663 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2023-10-12T19:42:59.668 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2023-10-12T19:42:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-10-12T19:42:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2023-10-12T19:42:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2023-10-12T19:42:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-10-12T19:42:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="20.04" 2023-10-12T19:42:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2023-10-12T19:42:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-10-12T19:42:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-10-12T19:42:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-10-12T19:42:59.670 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=focal 2023-10-12T19:42:59.671 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=focal 2023-10-12T19:42:59.671 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2023-10-12T19:42:59.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:42:59.780 INFO:teuthology.dispatcher.supervisor:Running job 7423374 2023-10-12T19:42:59.781 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-10-12_12:06:41-orch:cephadm-wip-adk2-testing-2023-10-11-1434-pacific-distro-default-smithi/7423374 --name adking-2023-10-12_12:06:41-orch:cephadm-wip-adk2-testing-2023-10-11-1434-pacific-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} -- /home/teuthworker/archive/adking-2023-10-12_12:06:41-orch:cephadm-wip-adk2-testing-2023-10-11-1434-pacific-distro-default-smithi/7423374/orig.config.yaml 2023-10-12T19:42:59.785 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-10-12_12:06:41-orch:cephadm-wip-adk2-testing-2023-10-11-1434-pacific-distro-default-smithi/7423374 2023-10-12T19:42:59.785 INFO:teuthology.dispatcher.supervisor:Job PID: 2349611 2023-10-12T19:42:59.786 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-12T19:44:59.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:47:00.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:49:00.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:51:00.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:53:00.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:55:00.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:57:00.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T19:59:01.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T20:01:01.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T20:03:01.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T20:05:01.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T20:07:01.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T20:07:01.786 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-12T20:07:01.897 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-12T20:07:01.898 INFO:teuthology.nuke:Checking targets against current locks 2023-10-12T20:07:01.948 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-12T20:07:01.949 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T20:07:01.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-10-12_12:06:41-orch:cephadm-wip-adk2-testing-2023-10-11-1434-pacific-distro-default-smithi/7423374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 19:37:16.073949', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-12T20:07:01.978 DEBUG:teuthology.nuke:shortname: smithi194 2023-10-12T20:07:01.979 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T20:07:02.004 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-10-12_12:06:41-orch:cephadm-wip-adk2-testing-2023-10-11-1434-pacific-distro-default-smithi/7423374', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 19:37:16.076419', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-10-12T20:07:02.027 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-12T20:07:02.028 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T20:07:02.056 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-12T20:07:02.056 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T20:07:02.073 INFO:teuthology.orchestra.console.smithi194:Power off 2023-10-12T20:07:02.073 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T20:07:02.083 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-12T20:07:02.097 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2023-10-12T20:07:02.098 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T20:07:02.120 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2023-10-12T20:07:02.184 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-12T20:07:02.221 INFO:teuthology.orchestra.console.smithi194:Power off completed 2023-10-12T20:07:02.343 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2023-10-12T20:07:02.368 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com