2023-11-28T21:59:20.772 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T21:59:20.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T21:59:20.921 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f799f51cdc0>, signals=[15]) 2023-11-28T21:59:20.922 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2023-11-28T21:59:20.922 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T21:59:20.922 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-11-28T21:59:20.953 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-11-28T21:59:20.953 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T21:59:20.953 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-28T21:59:21.070 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-28T21:59:21.085 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-28T21:59:21.112 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of ubuntu 22.04 2023-11-28T21:59:21.132 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of ubuntu 22.04 2023-11-28T21:59:21.365 INFO:teuthology.orchestra.console.smithi018:Power off 2023-11-28T21:59:21.365 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T21:59:21.379 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-28T21:59:21.379 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T21:59:21.388 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2023-11-28T21:59:21.388 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:21.399 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-28T21:59:21.400 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:21.419 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-28T21:59:21.420 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-11-28T21:59:21.520 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-28T21:59:21.621 INFO:teuthology.orchestra.console.smithi160:Power on 2023-11-28T21:59:21.621 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T21:59:21.641 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-11-28T21:59:21.641 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:21.665 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-28T21:59:25.423 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:25.532 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-11-28T21:59:25.665 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:25.775 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-28T21:59:29.534 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:29.675 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-11-28T21:59:29.776 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:29.884 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-11-28T21:59:29.985 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-11-28T21:59:30.086 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-11-28T21:59:33.678 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:33.787 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-11-28T21:59:33.888 INFO:teuthology.orchestra.console.smithi018:Power off completed 2023-11-28T21:59:33.989 INFO:teuthology.orchestra.console.smithi018:Power on 2023-11-28T21:59:33.989 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T21:59:34.012 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On 2023-11-28T21:59:34.012 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:34.034 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-11-28T21:59:38.038 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T21:59:38.149 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2023-11-28T21:59:38.250 INFO:teuthology.orchestra.console.smithi018:Power on completed 2023-11-28T21:59:38.350 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2023-11-28T22:02:39.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:02:42.594 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-11-28T22:02:48.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:02:51.650 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-11-28T22:02:57.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:00.738 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-11-28T22:03:06.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:09.798 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-11-28T22:03:15.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:16.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:18.882 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-11-28T22:03:19.426 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:03:24.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:25.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:27.970 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2023-11-28T22:03:28.482 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:03:33.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:34.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:37.538 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:03:43.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:46.594 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:03:52.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:03:55.682 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:04:01.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:04:04.742 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:04:10.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:04:13.830 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-11-28T22:04:19.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:04:33.991 WARNING:teuthology.provision.fog.smithi018:timed out 2023-11-28T22:04:39.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:04:40.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T22:04:40.225 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T22:04:40.721 INFO:teuthology.provision.fog.smithi018:Node is ready 2023-11-28T22:04:40.721 DEBUG:teuthology.orchestra.run.smithi018:> hostname 2023-11-28T22:04:40.769 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2023-11-28T22:04:40.769 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts 2023-11-28T22:04:40.817 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2023-11-28T22:04:40.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-11-28T22:04:40.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts 2023-11-28T22:04:40.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts 2023-11-28T22:04:41.039 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname 2023-11-28T22:04:41.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2023-11-28T22:04:41.156 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-11-28T22:04:41.205 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T22:04:41.205 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2023-11-28T22:04:41.205 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2023-11-28T22:04:41.205 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T22:04:41.205 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2023-11-28T22:04:41.205 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2023-11-28T22:04:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2023-11-28T22:04:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T22:04:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T22:04:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T22:04:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T22:04:41.206 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2023-11-28T22:04:41.207 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2023-11-28T22:04:41.209 DEBUG:teuthology.parallel:result is None 2023-11-28T22:05:19.874 WARNING:teuthology.provision.fog.smithi160:timed out 2023-11-28T22:05:26.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:05:26.488 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T22:05:26.489 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T22:05:26.950 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-11-28T22:05:26.950 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-11-28T22:05:26.998 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2023-11-28T22:05:26.998 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2023-11-28T22:05:27.046 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2023-11-28T22:05:27.046 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-11-28T22:05:27.186 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2023-11-28T22:05:27.201 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2023-11-28T22:05:27.255 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2023-11-28T22:05:27.314 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-11-28T22:05:27.372 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-11-28T22:05:27.422 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T22:05:27.423 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T22:05:27.423 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T22:05:27.423 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T22:05:27.423 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2023-11-28T22:05:27.423 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-11-28T22:05:27.424 DEBUG:teuthology.parallel:result is None 2023-11-28T22:05:27.605 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2023-11-28T22:05:27.605 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T22:05:27.629 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-11-28T22:05:27.629 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T22:05:27.655 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2023-11-28T22:05:27.655 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-11-28T22:05:27.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:05:27.732 DEBUG:teuthology.orchestra.run.smithi018:> true 2023-11-28T22:05:27.966 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2023-11-28T22:05:27.966 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2023-11-28T22:05:28.016 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2023-11-28T22:05:28.016 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2023-11-28T22:05:28.068 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T22:05:28.069 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T22:05:28.070 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T22:05:28.070 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2023-11-28T22:05:28.070 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2023-11-28T22:05:28.095 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-11-28T22:05:28.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-28T22:05:28.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T22:05:28.170 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-11-28T22:05:28.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-11-28T22:05:28.274 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-11-28T22:05:28.322 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-11-28T22:05:28.322 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-11-28T22:05:28.369 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T22:05:28.369 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Ubuntu" 2023-11-28T22:05:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="22.04" 2023-11-28T22:05:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T22:05:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_CODENAME=jammy 2023-11-28T22:05:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:ID=ubuntu 2023-11-28T22:05:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE=debian 2023-11-28T22:05:28.370 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T22:05:28.371 INFO:teuthology.orchestra.run.smithi160.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T22:05:28.371 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T22:05:28.371 INFO:teuthology.orchestra.run.smithi160.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T22:05:28.371 INFO:teuthology.orchestra.run.smithi160.stdout:UBUNTU_CODENAME=jammy 2023-11-28T22:05:28.372 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-11-28T22:05:28.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:05:28.502 INFO:teuthology.dispatcher.supervisor:Running job 7470212 2023-11-28T22:05:28.502 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470212 --name mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470212/orig.config.yaml 2023-11-28T22:05:28.505 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470212 2023-11-28T22:05:28.505 INFO:teuthology.dispatcher.supervisor:Job PID: 3320549 2023-11-28T22:05:28.505 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T22:07:28.606 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:09:28.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:11:28.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:13:29.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:15:29.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:17:29.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:19:29.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:21:35.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:23:36.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:25:36.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:27:36.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:29:36.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:31:36.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:33:36.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:35:37.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:37:38.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:39:38.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:41:38.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:43:38.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:45:38.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:47:39.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:49:39.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:51:39.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:53:39.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:55:39.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:57:39.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T22:59:40.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:01:40.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:03:42.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:05:43.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:07:43.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:09:43.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:11:43.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:13:43.748 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:15:43.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:17:44.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:19:44.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:21:44.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:23:44.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:25:44.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:27:44.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:29:45.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:31:45.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:33:45.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:35:45.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:37:45.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:39:45.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:41:46.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:43:46.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:45:46.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:47:46.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:49:46.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:51:46.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:53:46.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:55:47.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:57:47.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:59:47.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T23:59:47.483 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T23:59:47.676 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T23:59:47.676 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T23:59:47.727 DEBUG:teuthology.nuke:shortname: smithi018 2023-11-28T23:59:47.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T23:59:47.754 DEBUG:teuthology.nuke:shortname: smithi160 2023-11-28T23:59:47.755 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T23:59:47.758 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470212', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 21:59:19.920971', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHD8la7zf3reWnuKEDK6tjHjRUbNzNbdR/mAQAgQIKPTidAsd9MmCAl87IarYE7vj4QwrHuKjfGxOx1RZ0x0heQ='} 2023-11-28T23:59:47.779 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-11-28_16:18:11-rgw-rgw-wip-t63445-valg-supp_i002-distro-default-smithi/7470212', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 21:59:19.919418', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDU1l3GqS1qYBEn5dC3Klj03UzX52MBC4ep1J62qH+D8/HwrAkaecZJPRn59v8gTFGCsk/TASlPl1fheZt///o='} 2023-11-28T23:59:47.811 INFO:teuthology.orchestra.console.smithi018:Power off 2023-11-28T23:59:47.812 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T23:59:47.826 INFO:teuthology.orchestra.console.smithi160:Power off 2023-11-28T23:59:47.826 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T23:59:47.836 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2023-11-28T23:59:47.836 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:59:47.849 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-11-28T23:59:47.849 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T23:59:47.857 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2023-11-28T23:59:47.869 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-11-28T23:59:47.958 INFO:teuthology.orchestra.console.smithi018:Power off completed 2023-11-28T23:59:47.970 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-11-28T23:59:48.114 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com 2023-11-28T23:59:48.122 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com