2023-08-18T14:24:10.172 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-18T14:24:10.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:24:10.337 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f90be216ee0>, signals=[15]) 2023-08-18T14:24:10.338 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging 2023-08-18T14:24:10.339 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server 2023-08-18T14:24:10.339 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-08-18T14:24:10.357 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-08-18T14:24:10.358 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-08-18T14:24:10.358 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-08-18T14:24:10.360 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /host {"name": "smithi117"} 2023-08-18T14:24:10.381 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /host {"name": "smithi123"} 2023-08-18T14:24:10.433 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-18T14:24:10.442 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-18T14:24:10.488 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-18T14:24:10.488 DEBUG:teuthology.provision.fog.smithi117:FOG request: PUT /host/222 {"imageID": 6} 2023-08-18T14:24:10.491 DEBUG:teuthology.provision.fog.smithi123:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-18T14:24:10.491 DEBUG:teuthology.provision.fog.smithi123:FOG request: PUT /host/228 {"imageID": 6} 2023-08-18T14:24:10.532 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of ubuntu 22.04 2023-08-18T14:24:10.533 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:24:10.535 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of ubuntu 22.04 2023-08-18T14:24:10.535 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:24:10.611 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /tasktype {"name": "deploy"} 2023-08-18T14:24:10.614 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /tasktype {"name": "deploy"} 2023-08-18T14:24:10.656 DEBUG:teuthology.provision.fog.smithi117:FOG request: POST /host/222/task {"taskTypeID": 1} 2023-08-18T14:24:10.658 DEBUG:teuthology.provision.fog.smithi123:FOG request: POST /host/228/task {"taskTypeID": 1} 2023-08-18T14:24:10.719 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:24:10.725 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:24:10.845 INFO:teuthology.orchestra.console.smithi117:Power off 2023-08-18T14:24:10.846 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T14:24:10.863 INFO:teuthology.orchestra.console.smithi123:Power off 2023-08-18T14:24:10.865 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T14:24:10.882 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2023-08-18T14:24:10.883 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:10.895 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-08-18T14:24:10.896 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:10.908 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-18T14:24:10.915 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-18T14:24:11.016 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-08-18T14:24:11.117 INFO:teuthology.orchestra.console.smithi123:Power on 2023-08-18T14:24:11.118 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-18T14:24:11.140 DEBUG:teuthology.orchestra.console.smithi123:power on output: Chassis Power Control: Up/On 2023-08-18T14:24:11.203 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:11.239 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-18T14:24:14.913 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:15.025 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-18T14:24:15.241 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:15.350 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-18T14:24:19.028 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:19.139 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-18T14:24:19.240 INFO:teuthology.orchestra.console.smithi117:Power off completed 2023-08-18T14:24:19.341 INFO:teuthology.orchestra.console.smithi117:Power on 2023-08-18T14:24:19.341 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-18T14:24:19.352 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:19.362 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On 2023-08-18T14:24:19.363 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:19.382 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-18T14:24:19.461 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is on 2023-08-18T14:24:19.562 INFO:teuthology.orchestra.console.smithi123:Power on completed 2023-08-18T14:24:19.663 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-08-18T14:24:19.663 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:24:23.387 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:24:23.496 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on 2023-08-18T14:24:23.597 INFO:teuthology.orchestra.console.smithi117:Power on completed 2023-08-18T14:24:23.698 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish 2023-08-18T14:24:23.699 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:24:34.900 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:24:38.900 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:24:50.083 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:24:54.088 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:25:05.268 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:25:09.280 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:25:20.444 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:25:24.468 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:25:35.629 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:25:39.725 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:25:50.869 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:25:54.973 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:26:06.107 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:26:10.232 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:26:21.402 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:26:25.512 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:26:36.784 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:26:40.788 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:26:52.080 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:26:56.094 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:27:07.508 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:27:11.417 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:27:22.972 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:27:26.815 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:27:38.684 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:27:42.222 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:27:54.535 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:27:57.598 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:28:10.280 DEBUG:teuthology.provision.fog.smithi123:FOG request: GET /task/active None 2023-08-18T14:28:10.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:28:12.948 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:28:28.268 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:28:29.168 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-18T14:28:35.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:28:38.256 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-18T14:28:43.556 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:28:44.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:28:47.312 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-18T14:28:53.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:28:56.400 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-18T14:28:58.881 DEBUG:teuthology.provision.fog.smithi117:FOG request: GET /task/active None 2023-08-18T14:28:59.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:02.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:05.456 WARNING:teuthology.provision.fog.smithi123:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-08-18T14:29:11.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:17.552 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:29:23.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:26.608 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:29:32.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:35.664 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:29:41.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:44.720 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:29:50.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:29:53.808 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:29:59.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:11.476 WARNING:teuthology.provision.fog.smithi123:timed out 2023-08-18T14:30:17.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:17.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-18T14:30:17.661 DEBUG:teuthology.orchestra.run.smithi123:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-18T14:30:18.151 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-08-18T14:30:18.151 DEBUG:teuthology.orchestra.run.smithi123:> hostname 2023-08-18T14:30:18.196 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-08-18T14:30:18.196 DEBUG:teuthology.orchestra.run.smithi123:> grep smithi123.front.sepia.ceph.com /etc/hosts 2023-08-18T14:30:18.224 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:30:18.244 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-08-18T14:30:18.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-08-18T14:30:18.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hosts 2023-08-18T14:30:18.377 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/172.21.15.123/172.21.15.123/g' /etc/hosts 2023-08-18T14:30:18.435 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i -e 's/smithi123.front.sepia.ceph.com/smithi123/g' /etc/hostname 2023-08-18T14:30:18.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname smithi123 2023-08-18T14:30:18.539 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-08-18T14:30:18.588 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-18T14:30:18.588 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-08-18T14:30:18.588 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-18T14:30:18.589 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-18T14:30:18.590 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-18T14:30:18.590 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-08-18T14:30:18.590 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-08-18T14:30:18.592 DEBUG:teuthology.parallel:result is None 2023-08-18T14:30:24.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:27.280 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:30:33.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:33.286 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:30:39.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:39.294 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:30:45.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:45.301 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:30:51.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:51.306 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117 2023-08-18T14:30:57.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:57.640 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-18T14:30:57.640 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-18T14:30:58.439 INFO:teuthology.provision.fog.smithi117:Node is ready 2023-08-18T14:30:58.439 DEBUG:teuthology.orchestra.run.smithi117:> hostname 2023-08-18T14:30:58.487 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com 2023-08-18T14:30:58.487 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts 2023-08-18T14:30:58.535 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117 2023-08-18T14:30:58.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-08-18T14:30:58.696 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts 2023-08-18T14:30:58.710 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts 2023-08-18T14:30:58.767 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname 2023-08-18T14:30:58.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117 2023-08-18T14:30:58.877 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-08-18T14:30:58.923 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-18T14:30:58.923 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-08-18T14:30:58.923 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-18T14:30:58.924 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-18T14:30:58.925 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-18T14:30:58.925 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2023-08-18T14:30:58.925 INFO:teuthology.provision.fog.smithi117:Deploy complete! 2023-08-18T14:30:58.925 DEBUG:teuthology.parallel:result is None 2023-08-18T14:30:59.072 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com 2023-08-18T14:30:59.073 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-18T14:30:59.096 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-08-18T14:30:59.096 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-18T14:30:59.114 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server 2023-08-18T14:30:59.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-18T14:30:59.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:59.188 DEBUG:teuthology.orchestra.run.smithi117:> true 2023-08-18T14:30:59.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2023-08-18T14:30:59.275 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2023-08-18T14:30:59.326 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2023-08-18T14:30:59.326 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2023-08-18T14:30:59.374 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-18T14:30:59.374 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="Ubuntu" 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="22.04" 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_CODENAME=jammy 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:ID=ubuntu 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE=debian 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-18T14:30:59.375 INFO:teuthology.orchestra.run.smithi117.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-18T14:30:59.376 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-18T14:30:59.376 INFO:teuthology.orchestra.run.smithi117.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-18T14:30:59.376 INFO:teuthology.orchestra.run.smithi117.stdout:UBUNTU_CODENAME=jammy 2023-08-18T14:30:59.376 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2023-08-18T14:30:59.396 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-08-18T14:30:59.396 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-08-18T14:30:59.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-18T14:30:59.468 DEBUG:teuthology.orchestra.run.smithi123:> true 2023-08-18T14:30:59.703 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-08-18T14:30:59.704 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2023-08-18T14:30:59.751 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-08-18T14:30:59.751 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2023-08-18T14:30:59.799 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-18T14:30:59.799 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2023-08-18T14:30:59.799 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2023-08-18T14:30:59.799 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-18T14:30:59.799 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-18T14:30:59.800 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2023-08-18T14:30:59.801 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-08-18T14:30:59.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:30:59.906 INFO:teuthology.dispatcher.supervisor:Running job 7372388 2023-08-18T14:30:59.907 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-08-18_14:22:09-upgrade:octopus-x-quincy-distro-default-smithi/7372388 --name teuthology-2023-08-18_14:22:09-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} -- /home/teuthworker/archive/teuthology-2023-08-18_14:22:09-upgrade:octopus-x-quincy-distro-default-smithi/7372388/orig.config.yaml 2023-08-18T14:30:59.911 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-08-18_14:22:09-upgrade:octopus-x-quincy-distro-default-smithi/7372388 2023-08-18T14:30:59.911 INFO:teuthology.dispatcher.supervisor:Job PID: 15586 2023-08-18T14:30:59.912 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-18T14:33:00.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:35:00.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:37:00.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:39:00.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:41:00.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:43:00.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-18T14:43:00.938 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-18T14:43:01.096 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-18T14:43:01.097 INFO:teuthology.nuke:Checking targets against current locks 2023-08-18T14:43:01.161 DEBUG:teuthology.nuke:shortname: smithi117 2023-08-18T14:43:01.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T14:43:01.191 DEBUG:teuthology.nuke:shortname: smithi123 2023-08-18T14:43:01.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-18T14:43:01.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-18_14:22:09-upgrade:octopus-x-quincy-distro-default-smithi/7372388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-18 14:24:09.328653', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEuBADxMJFMy+MN1W018cb48mTA8WmMi4l0mFhq5P/Oa'} 2023-08-18T14:43:01.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-18_14:22:09-upgrade:octopus-x-quincy-distro-default-smithi/7372388', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-18 14:24:09.327290', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL904o70TZHrgtNmIcoV8uJDDMzRho2vBRR6ZZ0IPXOELmMlSz/dMMiCncFbRvtAgXE3Zx0Oo6rUdhrHjkalTi8='} 2023-08-18T14:43:01.288 INFO:teuthology.orchestra.console.smithi117:Power off 2023-08-18T14:43:01.289 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T14:43:01.325 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off 2023-08-18T14:43:01.326 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:43:01.349 INFO:teuthology.orchestra.console.smithi123:Power off 2023-08-18T14:43:01.350 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-18T14:43:01.370 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off 2023-08-18T14:43:01.393 DEBUG:teuthology.orchestra.console.smithi123:power off output: Chassis Power Control: Down/Off 2023-08-18T14:43:01.394 DEBUG:teuthology.orchestra.console.smithi123:pexpect command: ipmitool -H smithi123.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-18T14:43:01.427 DEBUG:teuthology.orchestra.console.smithi123:check power output: Chassis Power is off 2023-08-18T14:43:01.472 INFO:teuthology.orchestra.console.smithi117:Power off completed 2023-08-18T14:43:01.528 INFO:teuthology.orchestra.console.smithi123:Power off completed 2023-08-18T14:43:01.639 INFO:teuthology.lock.ops:unlocked: smithi117.front.sepia.ceph.com 2023-08-18T14:43:01.680 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com