2023-11-28T22:58:37.049 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T22:58:37.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:58:37.198 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fedc9d6adc0>, signals=[15]) 2023-11-28T22:58:37.199 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2023-11-28T22:58:37.199 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T22:58:37.200 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-11-28T22:58:37.229 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2023-11-28T22:58:37.229 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T22:58:37.229 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-11-28T22:58:37.342 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-28T22:58:37.359 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-28T22:58:37.400 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 22.04 2023-11-28T22:58:37.413 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of ubuntu 22.04 2023-11-28T22:58:37.728 INFO:teuthology.orchestra.console.smithi046:Power off 2023-11-28T22:58:37.728 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T22:58:37.740 INFO:teuthology.orchestra.console.smithi110:Power off 2023-11-28T22:58:37.741 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T22:58:37.751 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-11-28T22:58:37.752 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:37.763 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-11-28T22:58:37.763 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:37.776 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-28T22:58:37.785 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-11-28T22:58:41.781 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:41.789 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:41.891 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-28T22:58:41.897 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-11-28T22:58:45.894 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:45.901 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:46.003 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-28T22:58:46.009 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T22:58:46.105 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-11-28T22:58:46.110 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-11-28T22:58:46.206 INFO:teuthology.orchestra.console.smithi046:Power on 2023-11-28T22:58:46.206 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T22:58:46.213 INFO:teuthology.orchestra.console.smithi110:Power on 2023-11-28T22:58:46.213 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T22:58:46.230 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2023-11-28T22:58:46.231 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:46.240 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2023-11-28T22:58:46.240 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:46.254 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-28T22:58:46.262 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T22:58:50.258 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:50.265 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:50.368 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-28T22:58:50.374 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-28T22:58:54.373 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:54.380 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T22:58:54.488 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2023-11-28T22:58:54.524 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2023-11-28T22:58:54.589 INFO:teuthology.orchestra.console.smithi110:Power on completed 2023-11-28T22:58:54.625 INFO:teuthology.orchestra.console.smithi046:Power on completed 2023-11-28T22:58:54.690 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2023-11-28T22:58:54.726 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2023-11-28T23:02:10.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:10.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:13.922 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:02:13.923 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:02:19.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:19.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:22.978 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:02:22.979 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:02:28.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:28.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:32.038 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:02:32.039 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:02:38.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:38.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:41.122 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:02:41.123 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:02:47.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:47.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:50.178 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:02:50.179 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:02:56.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:56.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:02:59.234 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:02:59.235 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:03:05.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:03:05.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:03:36.803 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:03:42.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:03:42.808 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:03:48.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:03:48.816 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:03:54.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:03:54.824 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2023-11-28T23:04:00.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:04:01.037 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T23:04:01.037 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T23:04:01.622 INFO:teuthology.provision.fog.smithi110:Node is ready 2023-11-28T23:04:01.625 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2023-11-28T23:04:01.669 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com 2023-11-28T23:04:01.669 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts 2023-11-28T23:04:01.717 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110 2023-11-28T23:04:01.718 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-11-28T23:04:01.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts 2023-11-28T23:04:01.899 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts 2023-11-28T23:04:01.952 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname 2023-11-28T23:04:02.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2023-11-28T23:04:02.071 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-11-28T23:04:02.117 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:04:02.118 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:04:02.118 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:04:02.118 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:04:02.118 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:04:02.118 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2023-11-28T23:04:02.120 DEBUG:teuthology.parallel:result is None 2023-11-28T23:04:05.246 WARNING:teuthology.provision.fog.smithi046:timed out 2023-11-28T23:04:11.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:04:12.262 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2023-11-28T23:04:18.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:04:18.482 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T23:04:18.482 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T23:04:18.897 INFO:teuthology.provision.fog.smithi046:Node is ready 2023-11-28T23:04:18.897 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2023-11-28T23:04:18.947 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2023-11-28T23:04:18.947 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2023-11-28T23:04:18.994 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-28T23:04:18.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-11-28T23:04:19.133 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2023-11-28T23:04:19.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2023-11-28T23:04:19.206 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2023-11-28T23:04:19.263 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2023-11-28T23:04:19.317 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-11-28T23:04:19.370 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:04:19.370 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2023-11-28T23:04:19.370 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04" 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:04:19.371 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:04:19.372 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2023-11-28T23:04:19.372 DEBUG:teuthology.parallel:result is None 2023-11-28T23:04:19.562 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2023-11-28T23:04:19.562 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T23:04:19.585 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2023-11-28T23:04:19.585 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T23:04:19.603 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2023-11-28T23:04:19.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-28T23:04:19.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:04:19.682 DEBUG:teuthology.orchestra.run.smithi046:> true 2023-11-28T23:04:19.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2023-11-28T23:04:19.786 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2023-11-28T23:04:19.833 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2023-11-28T23:04:19.834 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2023-11-28T23:04:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:04:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2023-11-28T23:04:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04" 2023-11-28T23:04:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:04:19.881 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:04:19.882 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:04:19.882 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2023-11-28T23:04:19.964 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2023-11-28T23:04:19.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-11-28T23:04:19.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T23:04:20.042 DEBUG:teuthology.orchestra.run.smithi110:> true 2023-11-28T23:04:20.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2023-11-28T23:04:20.238 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2023-11-28T23:04:20.284 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2023-11-28T23:04:20.284 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2023-11-28T23:04:20.333 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2023-11-28T23:04:20.334 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T23:04:20.335 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T23:04:20.335 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T23:04:20.335 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T23:04:20.335 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2023-11-28T23:04:20.335 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2023-11-28T23:04:20.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:04:20.453 INFO:teuthology.dispatcher.supervisor:Running job 7470239 2023-11-28T23:04:20.453 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470239 --name mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470239/orig.config.yaml 2023-11-28T23:04:20.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470239 2023-11-28T23:04:20.458 INFO:teuthology.dispatcher.supervisor:Job PID: 3898140 2023-11-28T23:04:20.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T23:06:20.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:08:20.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:10:20.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:12:21.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:14:21.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:16:21.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:18:21.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:20:21.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:22:21.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:24:22.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:26:22.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:28:22.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:30:22.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:32:22.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:34:22.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:36:23.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:38:23.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:40:23.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:42:23.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:44:23.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:46:23.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:48:24.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:50:24.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:52:24.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:54:24.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:56:24.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:58:24.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:00:25.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:02:25.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:04:28.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:06:29.146 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:08:29.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:10:29.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:12:29.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:14:29.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:16:30.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:18:30.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:20:30.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:22:30.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:24:30.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:26:30.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:28:30.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:30:31.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:32:35.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:34:36.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:36:36.259 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:38:36.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:40:36.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:42:36.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:44:36.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:46:36.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:48:37.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:50:37.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:52:37.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:54:37.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T00:54:37.603 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T00:54:37.757 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T00:54:37.757 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T00:54:37.798 DEBUG:teuthology.nuke:shortname: smithi046 2023-11-29T00:54:37.799 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T00:54:37.819 DEBUG:teuthology.nuke:shortname: smithi110 2023-11-29T00:54:37.820 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T00:54:37.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 22:58:36.222353', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDJ5VVCj/5rcUKvs3YOqvh66PbAa+OfaEDXlD2Y+9Za3c+IgXULWCdQPzVayY4FC4yA+h7gqyUd52yN/A7W1Fnw='} 2023-11-29T00:54:37.841 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 22:58:36.221003', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC7gHIsdG2Dqbary1H4Q6YbaoGCxeI92B+tZqKBCQv08j9qRVDLwmyGsW6W0BjNgBZ6JgdS5Bopt9AgtvOdSwp8='} 2023-11-29T00:54:37.870 INFO:teuthology.orchestra.console.smithi046:Power off 2023-11-29T00:54:37.870 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T00:54:37.890 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2023-11-29T00:54:37.891 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T00:54:37.901 INFO:teuthology.orchestra.console.smithi110:Power off 2023-11-29T00:54:37.901 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T00:54:37.911 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2023-11-29T00:54:37.919 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2023-11-29T00:54:37.919 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T00:54:37.938 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2023-11-29T00:54:38.012 INFO:teuthology.orchestra.console.smithi046:Power off completed 2023-11-29T00:54:38.039 INFO:teuthology.orchestra.console.smithi110:Power off completed 2023-11-29T00:54:38.168 INFO:teuthology.lock.ops:unlocked: smithi046.front.sepia.ceph.com 2023-11-29T00:54:38.185 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com