2023-11-29T09:42:27.194 INFO:root:teuthology version: 0.0.1.dev212+g735a43c 2023-11-29T09:42:27.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:42:27.310 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fccba304dc0>, signals=[15]) 2023-11-29T09:42:27.311 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-11-29T09:42:27.311 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T09:42:27.311 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-11-29T09:42:27.328 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-11-29T09:42:27.328 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T09:42:27.328 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-11-29T09:42:27.438 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-29T09:42:27.450 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-29T09:42:27.502 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of ubuntu 22.04 2023-11-29T09:42:27.506 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 22.04 2023-11-29T09:42:28.187 INFO:teuthology.orchestra.console.smithi131:Power off 2023-11-29T09:42:28.187 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T09:42:28.199 INFO:teuthology.orchestra.console.smithi107:Power off 2023-11-29T09:42:28.199 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T09:42:28.207 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-11-29T09:42:28.207 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:28.221 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-11-29T09:42:28.221 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:28.228 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T09:42:28.243 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T09:42:28.329 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-11-29T09:42:28.430 INFO:teuthology.orchestra.console.smithi131:Power on 2023-11-29T09:42:28.430 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T09:42:28.452 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-11-29T09:42:28.452 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:28.471 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T09:42:32.246 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:32.354 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T09:42:32.473 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:32.580 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-11-29T09:42:32.681 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-11-29T09:42:32.781 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-11-29T09:42:36.358 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:36.468 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T09:42:40.472 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:40.581 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T09:42:40.681 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-11-29T09:42:40.782 INFO:teuthology.orchestra.console.smithi107:Power on 2023-11-29T09:42:40.782 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T09:42:40.801 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-11-29T09:42:40.801 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:40.821 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T09:42:44.822 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T09:42:44.930 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-11-29T09:42:45.031 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-11-29T09:42:45.131 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-11-29T09:48:20.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:38.882 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:48:44.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:47.970 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:48:53.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:48:57.026 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:49:03.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:06.082 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:49:12.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:15.138 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:49:21.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:39.554 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:49:45.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:48.614 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:49:54.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:49:56.643 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:50:02.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:02.651 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:50:08.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:08.660 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:50:09.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:12.962 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T09:50:14.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:14.664 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:50:18.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:20.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:20.668 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-11-29T09:50:22.018 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T09:50:26.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:26.862 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T09:50:26.862 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T09:50:27.297 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-11-29T09:50:27.297 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-11-29T09:50:27.345 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-11-29T09:50:27.345 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-11-29T09:50:27.392 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-11-29T09:50:27.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-11-29T09:50:27.571 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-11-29T09:50:27.585 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-11-29T09:50:27.641 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-11-29T09:50:27.695 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-11-29T09:50:27.749 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-11-29T09:50:27.795 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:50:27.796 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2023-11-29T09:50:27.796 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2023-11-29T09:50:27.796 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:50:27.796 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:50:27.797 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:50:27.798 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-11-29T09:50:27.799 DEBUG:teuthology.parallel:result is None 2023-11-29T09:50:28.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:31.074 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T09:50:37.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:40.130 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T09:50:46.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:49.218 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T09:50:55.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:50:58.274 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-11-29T09:51:04.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:52:04.338 WARNING:teuthology.provision.fog.smithi107:timed out 2023-11-29T09:52:10.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:52:10.532 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T09:52:10.532 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T09:52:10.976 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-11-29T09:52:10.976 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-11-29T09:52:11.024 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-11-29T09:52:11.025 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-11-29T09:52:11.073 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-11-29T09:52:11.074 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-11-29T09:52:11.198 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-11-29T09:52:11.215 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-11-29T09:52:11.269 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-11-29T09:52:11.326 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-11-29T09:52:11.379 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-11-29T09:52:11.429 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:52:11.429 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-11-29T09:52:11.429 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2023-11-29T09:52:11.429 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:52:11.430 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:52:11.430 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-11-29T09:52:11.431 DEBUG:teuthology.parallel:result is None 2023-11-29T09:52:11.607 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-11-29T09:52:11.607 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T09:52:11.632 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-11-29T09:52:11.632 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T09:52:11.649 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-11-29T09:52:11.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-11-29T09:52:11.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:52:11.721 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-11-29T09:52:11.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-11-29T09:52:11.822 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-11-29T09:52:11.870 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-11-29T09:52:11.870 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2023-11-29T09:52:11.917 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2023-11-29T09:52:11.918 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:52:11.918 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:52:11.918 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:52:11.918 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:52:11.918 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:52:11.918 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-11-29T09:52:11.940 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-11-29T09:52:11.940 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-11-29T09:52:11.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T09:52:12.015 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-11-29T09:52:12.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-11-29T09:52:12.254 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-11-29T09:52:12.301 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-11-29T09:52:12.301 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-11-29T09:52:12.349 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-29T09:52:12.350 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2023-11-29T09:52:12.351 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-11-29T09:52:12.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:52:12.458 INFO:teuthology.dispatcher.supervisor:Running job 7470589 2023-11-29T09:52:12.458 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_735a43c3d8e74286f980f1d14817fb093cd8147e/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470589 --name mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec-profile s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470589/orig.config.yaml 2023-11-29T09:52:12.461 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470589 2023-11-29T09:52:12.461 INFO:teuthology.dispatcher.supervisor:Job PID: 2132525 2023-11-29T09:52:12.461 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-29T09:54:12.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:56:12.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T09:58:12.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:00:13.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:02:13.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:04:13.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:06:13.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:08:13.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:10:13.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:12:14.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:14:14.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:16:14.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:18:14.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:20:14.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:22:14.870 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:24:15.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:26:15.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:28:15.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:30:15.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:32:15.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:34:15.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:36:16.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:38:16.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:40:16.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:42:16.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:44:16.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:46:16.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:48:16.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:50:17.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:52:17.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:54:17.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:56:17.516 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T10:58:17.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:00:17.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:02:17.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:04:18.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:06:18.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:08:18.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:10:18.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:12:18.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:14:18.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:16:19.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:18:19.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:20:19.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:22:19.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T11:22:19.589 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T11:22:19.698 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T11:22:19.698 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T11:22:19.742 DEBUG:teuthology.nuke:shortname: smithi107 2023-11-29T11:22:19.743 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T11:22:19.767 DEBUG:teuthology.nuke:shortname: smithi131 2023-11-29T11:22:19.767 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T11:22:19.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 09:42:26.420653', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNURwLRi0fGk6dhNk1GUZo9pG90DOsZnnvz4locvPJEku5Hv+41ID0fE5jzH2UBH6sjzq9kex/UR9XtXYyLsy1o='} 2023-11-29T11:22:19.791 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-29_09:41:25-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 09:42:26.418937', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHufYg5wjBArV0KycYl4qOL3HuRBHA60KmYKzzjQQbvvUp9YfE2dle0c6ZdP51/fWJvJKw/zG4WS6ak7XVIhP9A='} 2023-11-29T11:22:19.819 INFO:teuthology.orchestra.console.smithi107:Power off 2023-11-29T11:22:19.819 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T11:22:19.835 INFO:teuthology.orchestra.console.smithi131:Power off 2023-11-29T11:22:19.835 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T11:22:19.843 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-11-29T11:22:19.843 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:22:19.855 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-11-29T11:22:19.855 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T11:22:19.861 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-11-29T11:22:19.874 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-11-29T11:22:19.962 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-11-29T11:22:19.975 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-11-29T11:22:20.114 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-11-29T11:22:20.122 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com