2023-08-25T14:23:58.994 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-25T14:23:58.996 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:23:59.128 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbd13d77310>, signals=[15]) 2023-08-25T14:23:59.130 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-08-25T14:23:59.130 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T14:23:59.130 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-25T14:23:59.155 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-08-25T14:23:59.156 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-08-25T14:23:59.156 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-08-25T14:23:59.157 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-08-25T14:23:59.172 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-08-25T14:23:59.236 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-25T14:23:59.241 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-25T14:23:59.272 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-25T14:23:59.272 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 6} 2023-08-25T14:23:59.286 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-25T14:23:59.287 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 6} 2023-08-25T14:23:59.327 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of ubuntu 22.04 2023-08-25T14:23:59.327 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:23:59.337 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 22.04 2023-08-25T14:23:59.337 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:23:59.434 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T14:23:59.438 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-08-25T14:23:59.470 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-08-25T14:23:59.480 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-08-25T14:23:59.516 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:23:59.534 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:23:59.658 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-25T14:23:59.659 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T14:23:59.675 INFO:teuthology.orchestra.console.smithi184:Power off 2023-08-25T14:23:59.676 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T14:23:59.685 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-25T14:23:59.686 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:23:59.711 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-25T14:23:59.718 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-08-25T14:23:59.719 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:23:59.739 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-08-25T14:24:03.716 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:03.740 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:03.827 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-25T14:24:03.851 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-08-25T14:24:07.832 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:07.852 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:07.943 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-25T14:24:07.962 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-08-25T14:24:11.949 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:11.963 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:12.058 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-25T14:24:12.072 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-25T14:24:12.160 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-25T14:24:12.174 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-08-25T14:24:12.261 INFO:teuthology.orchestra.console.smithi153:Power on 2023-08-25T14:24:12.262 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T14:24:12.275 INFO:teuthology.orchestra.console.smithi184:Power on 2023-08-25T14:24:12.275 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-25T14:24:12.284 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-08-25T14:24:12.285 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:12.295 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-08-25T14:24:12.296 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:12.307 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-25T14:24:12.316 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-25T14:24:16.312 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:16.319 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:16.421 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-25T14:24:16.429 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-08-25T14:24:16.530 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-08-25T14:24:16.631 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-08-25T14:24:16.824 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:24:20.426 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:24:20.549 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-25T14:24:20.650 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-08-25T14:24:20.750 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-08-25T14:24:20.751 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:24:32.021 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:24:35.913 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:24:47.184 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:24:51.080 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:25:02.356 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:25:06.232 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:25:17.548 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:25:21.384 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:25:32.739 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:25:36.536 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:25:47.927 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:25:51.705 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:26:03.102 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:26:06.876 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:26:18.285 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:26:22.068 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:26:33.473 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:26:37.276 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:26:48.665 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:26:52.463 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:27:03.868 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:27:07.684 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:27:19.084 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:27:22.881 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:27:34.292 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:27:38.073 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:27:49.496 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:27:53.268 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:28:04.676 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:28:08.468 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:28:19.864 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:28:23.640 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:28:35.054 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:28:38.796 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:28:50.253 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:28:53.960 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:29:05.436 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-25T14:29:05.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:29:08.656 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:29:09.107 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:29:14.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:29:17.712 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:29:23.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:29:24.285 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:29:26.804 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:29:32.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:29:35.888 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:29:39.454 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:29:41.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:29:44.944 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:29:50.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:29:54.000 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:29:54.638 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:30:00.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:30:09.812 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:30:24.963 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:30:31.536 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:30:37.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:30:37.544 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:30:40.099 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:30:43.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:30:43.549 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:30:49.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:30:49.557 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-25T14:30:55.216 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:30:55.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:30:55.911 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T14:30:55.912 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T14:30:56.614 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-08-25T14:30:56.614 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-08-25T14:30:56.660 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-08-25T14:30:56.661 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-08-25T14:30:56.708 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-08-25T14:30:56.709 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-08-25T14:30:56.854 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-08-25T14:30:56.869 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-08-25T14:30:56.924 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-08-25T14:30:56.979 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-08-25T14:30:57.031 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-08-25T14:30:57.080 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-25T14:30:57.080 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-08-25T14:30:57.080 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-25T14:30:57.081 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-25T14:30:57.082 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-25T14:30:57.082 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2023-08-25T14:30:57.082 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-08-25T14:30:57.084 DEBUG:teuthology.parallel:result is None 2023-08-25T14:31:10.332 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:31:25.447 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:31:40.547 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:31:55.632 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-25T14:31:55.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:31:58.768 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:04.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:32:07.824 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:13.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:32:16.880 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:22.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:32:25.936 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:31.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:32:34.992 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:40.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:32:44.052 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:50.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:32:53.140 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-25T14:32:59.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:33:59.208 WARNING:teuthology.provision.fog.smithi153:timed out 2023-08-25T14:34:05.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:34:05.506 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-25T14:34:05.507 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-25T14:34:05.933 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-08-25T14:34:05.933 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-08-25T14:34:05.979 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-08-25T14:34:05.979 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-08-25T14:34:06.027 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-08-25T14:34:06.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-08-25T14:34:06.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-08-25T14:34:06.178 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-08-25T14:34:06.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-08-25T14:34:06.294 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-08-25T14:34:06.350 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-25T14:34:06.396 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-25T14:34:06.396 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-25T14:34:06.396 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2023-08-25T14:34:06.396 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-25T14:34:06.397 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-25T14:34:06.398 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2023-08-25T14:34:06.398 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-08-25T14:34:06.398 DEBUG:teuthology.parallel:result is None 2023-08-25T14:34:06.553 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-08-25T14:34:06.554 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T14:34:06.585 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-08-25T14:34:06.586 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-25T14:34:06.610 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-08-25T14:34:06.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-25T14:34:06.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:34:06.688 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-08-25T14:34:06.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-25T14:34:06.777 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-08-25T14:34:06.823 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-08-25T14:34:06.823 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-25T14:34:06.872 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-25T14:34:06.873 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-25T14:34:06.873 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2023-08-25T14:34:06.873 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-25T14:34:06.873 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2023-08-25T14:34:06.874 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-25T14:34:06.874 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-25T14:34:06.875 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-25T14:34:06.875 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-25T14:34:06.875 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-25T14:34:06.875 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-25T14:34:06.876 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2023-08-25T14:34:06.876 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-25T14:34:06.901 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-08-25T14:34:06.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-08-25T14:34:06.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-25T14:34:06.978 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-08-25T14:34:07.195 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-08-25T14:34:07.196 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-08-25T14:34:07.242 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-08-25T14:34:07.242 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-08-25T14:34:07.291 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-25T14:34:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Ubuntu" 2023-08-25T14:34:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="22.04" 2023-08-25T14:34:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-25T14:34:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_CODENAME=jammy 2023-08-25T14:34:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:ID=ubuntu 2023-08-25T14:34:07.292 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE=debian 2023-08-25T14:34:07.293 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-25T14:34:07.293 INFO:teuthology.orchestra.run.smithi184.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-25T14:34:07.293 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-25T14:34:07.293 INFO:teuthology.orchestra.run.smithi184.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-25T14:34:07.293 INFO:teuthology.orchestra.run.smithi184.stdout:UBUNTU_CODENAME=jammy 2023-08-25T14:34:07.294 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-08-25T14:34:07.317 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:34:07.394 INFO:teuthology.dispatcher.supervisor:Running job 7379487 2023-08-25T14:34:07.395 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-08-25_14:22:13-upgrade:octopus-x-quincy-distro-default-smithi/7379487 --name teuthology-2023-08-25_14:22:13-upgrade:octopus-x-quincy-distro-default-smithi --description upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} -- /home/teuthworker/archive/teuthology-2023-08-25_14:22:13-upgrade:octopus-x-quincy-distro-default-smithi/7379487/orig.config.yaml 2023-08-25T14:34:07.398 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-08-25_14:22:13-upgrade:octopus-x-quincy-distro-default-smithi/7379487 2023-08-25T14:34:07.399 INFO:teuthology.dispatcher.supervisor:Job PID: 21031 2023-08-25T14:34:07.399 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-25T14:36:07.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:38:07.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:40:07.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:42:08.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:44:08.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:46:08.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:48:08.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-25T14:48:08.573 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-25T14:48:08.667 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-25T14:48:08.668 INFO:teuthology.nuke:Checking targets against current locks 2023-08-25T14:48:08.712 DEBUG:teuthology.nuke:shortname: smithi153 2023-08-25T14:48:08.713 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T14:48:08.728 DEBUG:teuthology.nuke:shortname: smithi184 2023-08-25T14:48:08.728 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-25T14:48:08.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-25_14:22:13-upgrade:octopus-x-quincy-distro-default-smithi/7379487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 14:23:58.206045', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKeTCFmn8Tykh6oagBX2POki7S4TpcIC0BlweBGR5vnwOTX59u2AFppS7yjs7BXItujj1YKw22zhxNJqpePQxxY='} 2023-08-25T14:48:08.753 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-08-25_14:22:13-upgrade:octopus-x-quincy-distro-default-smithi/7379487', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-25 14:23:58.207177', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJiGxlElt5133X5JERqewgqrtgkbpd8QkrqRZKAOvl+qzDbErq6wobsr4pvPXrVYfX34D3FI5/AvRlVD4s0ZlbA='} 2023-08-25T14:48:08.777 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-25T14:48:08.777 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T14:48:08.798 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-25T14:48:08.799 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:48:08.816 INFO:teuthology.orchestra.console.smithi184:Power off 2023-08-25T14:48:08.816 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-25T14:48:08.827 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-25T14:48:08.837 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-08-25T14:48:08.837 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-25T14:48:08.861 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-25T14:48:08.928 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-25T14:48:08.962 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-08-25T14:48:09.080 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-08-25T14:48:09.115 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com