2023-09-21T09:40:04.413 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T09:40:04.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:40:04.551 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe7089e8c10>, signals=[15]) 2023-09-21T09:40:04.552 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-09-21T09:40:04.552 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T09:40:04.553 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-21T09:40:04.572 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2023-09-21T09:40:04.572 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2023-09-21T09:40:04.573 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-21T09:40:04.575 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-09-21T09:40:04.597 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /host {"name": "smithi103"} 2023-09-21T09:40:04.649 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-21T09:40:04.675 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-09-21T09:40:04.695 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-21T09:40:04.695 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 6} 2023-09-21T09:40:04.725 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-09-21T09:40:04.726 DEBUG:teuthology.provision.fog.smithi103:FOG request: PUT /host/208 {"imageID": 6} 2023-09-21T09:40:04.734 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of ubuntu 22.04 2023-09-21T09:40:04.734 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:40:04.775 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T09:40:04.778 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of ubuntu 22.04 2023-09-21T09:40:04.778 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:40:04.812 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-09-21T09:40:04.819 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /tasktype {"name": "deploy"} 2023-09-21T09:40:04.851 DEBUG:teuthology.provision.fog.smithi103:FOG request: POST /host/208/task {"taskTypeID": 1} 2023-09-21T09:40:04.899 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:40:04.909 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:40:04.982 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-21T09:40:04.983 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T09:40:04.996 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-21T09:40:04.997 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T09:40:05.046 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-21T09:40:05.047 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:05.056 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2023-09-21T09:40:05.056 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:05.069 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-21T09:40:05.077 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-21T09:40:09.074 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:09.082 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:09.184 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-21T09:40:09.192 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-21T09:40:13.186 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:13.194 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:13.297 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-21T09:40:13.303 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-21T09:40:13.399 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-21T09:40:13.404 INFO:teuthology.orchestra.console.smithi103:Power off completed 2023-09-21T09:40:13.500 INFO:teuthology.orchestra.console.smithi002:Power on 2023-09-21T09:40:13.501 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T09:40:13.508 INFO:teuthology.orchestra.console.smithi103:Power on 2023-09-21T09:40:13.508 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-21T09:40:13.522 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-09-21T09:40:13.522 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:13.531 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2023-09-21T09:40:13.532 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:13.546 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-21T09:40:13.556 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-21T09:40:17.550 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:17.557 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:17.659 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-21T09:40:17.665 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2023-09-21T09:40:21.664 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:21.671 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T09:40:21.773 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-09-21T09:40:21.780 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2023-09-21T09:40:21.875 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-09-21T09:40:21.881 INFO:teuthology.orchestra.console.smithi103:Power on completed 2023-09-21T09:40:21.976 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-09-21T09:40:21.977 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:40:21.982 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2023-09-21T09:40:21.983 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:40:37.046 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:40:37.047 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:40:52.123 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:40:52.125 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:41:07.202 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:41:07.203 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:41:22.279 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:41:22.281 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:41:37.366 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:41:37.367 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:41:52.448 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:41:52.449 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:42:07.526 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:42:07.527 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:42:22.602 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:42:22.604 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:42:37.678 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:42:37.680 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:42:52.758 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:42:52.760 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:43:07.842 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:43:07.843 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:43:22.926 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-09-21T09:43:22.928 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:43:22.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:43:38.009 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:43:41.470 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-21T09:43:47.475 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:43:50.554 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-21T09:43:53.081 DEBUG:teuthology.provision.fog.smithi103:FOG request: GET /task/active None 2023-09-21T09:43:53.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:43:56.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:43:59.614 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-21T09:44:05.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:08.698 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-21T09:44:11.678 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:44:14.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:17.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:20.762 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:44:26.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:29.822 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:44:35.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:38.910 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:44:44.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:47.994 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:44:53.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:44:57.050 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:45:03.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:45:14.716 WARNING:teuthology.provision.fog.smithi002:timed out 2023-09-21T09:45:20.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:45:27.962 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-09-21T09:45:33.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:45:34.170 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T09:45:34.171 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T09:45:34.599 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-09-21T09:45:34.600 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-09-21T09:45:34.646 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-09-21T09:45:34.647 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-09-21T09:45:34.694 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-09-21T09:45:34.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-21T09:45:34.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-09-21T09:45:34.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-09-21T09:45:34.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-09-21T09:45:34.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-09-21T09:45:34.990 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-21T09:45:35.042 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T09:45:35.042 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-09-21T09:45:35.042 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="22.04" 2023-09-21T09:45:35.043 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T09:45:35.043 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=jammy 2023-09-21T09:45:35.043 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-09-21T09:45:35.043 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-09-21T09:45:35.043 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T09:45:35.043 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T09:45:35.044 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T09:45:35.044 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T09:45:35.044 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=jammy 2023-09-21T09:45:35.045 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-09-21T09:45:35.046 DEBUG:teuthology.parallel:result is None 2023-09-21T09:46:03.081 WARNING:teuthology.provision.fog.smithi103:timed out 2023-09-21T09:46:09.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:46:09.088 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-09-21T09:46:15.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:46:15.270 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-21T09:46:15.271 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-21T09:46:15.756 INFO:teuthology.provision.fog.smithi103:Node is ready 2023-09-21T09:46:15.757 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2023-09-21T09:46:15.804 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103.front.sepia.ceph.com 2023-09-21T09:46:15.804 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi103.front.sepia.ceph.com /etc/hosts 2023-09-21T09:46:15.856 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103 smithi103.front.sepia.ceph.com smithi103 2023-09-21T09:46:15.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-21T09:46:16.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hosts 2023-09-21T09:46:16.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.103/172.21.15.103/g' /etc/hosts 2023-09-21T09:46:16.073 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi103.front.sepia.ceph.com/smithi103/g' /etc/hostname 2023-09-21T09:46:16.133 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2023-09-21T09:46:16.187 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-21T09:46:16.231 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T09:46:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2023-09-21T09:46:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="22.04" 2023-09-21T09:46:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T09:46:16.232 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=jammy 2023-09-21T09:46:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2023-09-21T09:46:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2023-09-21T09:46:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T09:46:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T09:46:16.233 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T09:46:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T09:46:16.234 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=jammy 2023-09-21T09:46:16.234 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2023-09-21T09:46:16.235 DEBUG:teuthology.parallel:result is None 2023-09-21T09:46:16.411 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-09-21T09:46:16.412 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T09:46:16.443 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2023-09-21T09:46:16.444 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-21T09:46:16.469 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-09-21T09:46:16.470 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-09-21T09:46:16.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:46:16.548 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-09-21T09:46:16.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-09-21T09:46:16.778 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-09-21T09:46:16.825 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-09-21T09:46:16.825 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-09-21T09:46:16.873 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T09:46:16.873 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="Ubuntu" 2023-09-21T09:46:16.873 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="22.04" 2023-09-21T09:46:16.874 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T09:46:16.874 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_CODENAME=jammy 2023-09-21T09:46:16.874 INFO:teuthology.orchestra.run.smithi002.stdout:ID=ubuntu 2023-09-21T09:46:16.874 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE=debian 2023-09-21T09:46:16.874 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T09:46:16.875 INFO:teuthology.orchestra.run.smithi002.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T09:46:16.875 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T09:46:16.875 INFO:teuthology.orchestra.run.smithi002.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T09:46:16.875 INFO:teuthology.orchestra.run.smithi002.stdout:UBUNTU_CODENAME=jammy 2023-09-21T09:46:16.876 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-09-21T09:46:16.902 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2023-09-21T09:46:16.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-21T09:46:16.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T09:46:16.976 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-09-21T09:46:17.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-09-21T09:46:17.078 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-09-21T09:46:17.125 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-09-21T09:46:17.125 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-09-21T09:46:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-09-21T09:46:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2023-09-21T09:46:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="22.04" 2023-09-21T09:46:17.172 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-09-21T09:46:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=jammy 2023-09-21T09:46:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2023-09-21T09:46:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2023-09-21T09:46:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-21T09:46:17.173 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-21T09:46:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-21T09:46:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-21T09:46:17.174 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=jammy 2023-09-21T09:46:17.175 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-09-21T09:46:17.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:46:17.291 INFO:teuthology.dispatcher.supervisor:Running job 7399382 2023-09-21T09:46:17.292 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-09-20_11:11:11-rgw-rgw-wip-t62141-valg-supp_i007-distro-default-smithi/7399382 --name mkogan-2023-09-20_11:11:11-rgw-rgw-wip-t62141-valg-supp_i007-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/three-zones supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/mkogan-2023-09-20_11:11:11-rgw-rgw-wip-t62141-valg-supp_i007-distro-default-smithi/7399382/orig.config.yaml 2023-09-21T09:46:17.294 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-09-20_11:11:11-rgw-rgw-wip-t62141-valg-supp_i007-distro-default-smithi/7399382 2023-09-21T09:46:17.295 INFO:teuthology.dispatcher.supervisor:Job PID: 2820285 2023-09-21T09:46:17.295 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-21T09:48:17.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:50:17.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:52:17.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:54:17.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:56:18.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T09:58:18.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:00:18.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:02:18.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:04:18.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:06:18.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:08:19.059 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:10:19.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:12:19.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:14:19.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:16:19.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:18:19.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:20:20.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:22:20.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:24:20.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:26:20.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:28:20.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:30:20.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:32:21.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:34:21.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:36:21.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:38:21.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:40:21.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:42:21.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:44:22.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:46:22.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:48:22.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:50:22.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:52:22.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:54:22.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:56:22.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T10:58:23.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:00:23.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:02:23.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:04:23.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:06:23.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:08:23.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:10:23.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:12:24.158 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:14:24.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:16:24.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:18:24.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:20:24.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:22:24.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:24:25.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:26:25.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:28:25.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:30:25.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:32:25.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:34:25.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:36:26.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:38:26.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:40:26.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:42:26.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:44:26.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:46:26.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:48:27.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:50:27.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:52:27.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:54:27.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:56:27.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T11:58:27.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:00:28.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:02:28.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:04:28.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:06:28.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:08:28.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:08:28.817 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-21T12:08:29.026 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-21T12:08:29.027 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T12:08:29.073 DEBUG:teuthology.nuke:shortname: smithi002 2023-09-21T12:08:29.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T12:08:29.096 DEBUG:teuthology.nuke:shortname: smithi103 2023-09-21T12:08:29.096 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T12:08:29.100 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-09-20_11:11:11-rgw-rgw-wip-t62141-valg-supp_i007-distro-default-smithi/7399382', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 09:40:03.478613', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDVrneAeqeYyWR8EsWEsUcTu9ORRNSjEapsJM55Wxyv+QWSbHtCmy6hdPBWU5SV5OyCIzk2AJfPUaL3tjH1qZiY='} 2023-09-21T12:08:29.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-09-20_11:11:11-rgw-rgw-wip-t62141-valg-supp_i007-distro-default-smithi/7399382', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 09:40:03.480014', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBdtk5kpPG6eYNxsbUUhP94wDXvlRmA02PaokXMYSATdfsN+ggFZAqSpAnE008SiaWHo10lbXGPIxwUzYXOv798='} 2023-09-21T12:08:29.676 INFO:teuthology.orchestra.console.smithi002:Power off 2023-09-21T12:08:29.677 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T12:08:29.692 INFO:teuthology.orchestra.console.smithi103:Power off 2023-09-21T12:08:29.693 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T12:08:29.707 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-09-21T12:08:29.708 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:08:29.731 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-09-21T12:08:29.832 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-09-21T12:08:29.989 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-09-21T12:08:49.772 DEBUG:teuthology.orchestra.console.smithi103:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T12:08:49.772 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T12:09:09.848 DEBUG:teuthology.orchestra.console.smithi103:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T12:09:09.849 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T12:09:29.918 DEBUG:teuthology.orchestra.console.smithi103:power off output: Error: Unable to establish IPMI v2 / RMCP+ session 2023-09-21T12:09:29.919 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:09:30.927 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:09:34.930 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:09:36.038 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:09:40.042 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:09:41.153 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:09:45.154 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:09:46.263 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:09:50.266 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:09:51.375 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:09:55.378 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:09:56.487 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:00.490 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:01.599 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:05.602 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:06.711 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:10.715 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:11.825 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:15.826 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:16.934 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:20.938 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:22.046 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:26.051 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:27.161 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:31.163 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:32.273 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:36.278 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:37.386 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:41.390 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T12:10:42.498 DEBUG:teuthology.orchestra.console.smithi103:check power output: 2023-09-21T12:10:42.499 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds 2023-09-21T12:10:42.499 ERROR:teuthology.orchestra.console.smithi103:Failed to power off 2023-09-21T12:10:42.553 INFO:teuthology.lock.ops:unlocked: smithi103.front.sepia.ceph.com