2023-11-28T12:14:44.199 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-28T12:14:44.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:14:44.340 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa31057c550>, signals=[15]) 2023-11-28T12:14:44.340 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-11-28T12:14:44.340 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T12:14:44.340 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-28T12:14:44.361 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-11-28T12:14:44.361 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T12:14:44.361 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-28T12:14:44.475 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.4 (ID 7) 2023-11-28T12:14:44.496 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.4 (ID 7) 2023-11-28T12:14:44.522 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.4 2023-11-28T12:14:44.539 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.4 2023-11-28T12:14:44.804 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-28T12:14:44.804 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:14:44.818 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-28T12:14:44.818 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:14:44.826 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-28T12:14:44.826 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:44.841 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-28T12:14:44.841 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:44.849 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T12:14:44.865 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-28T12:14:48.854 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:48.866 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:48.964 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T12:14:48.978 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-28T12:14:52.966 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:52.979 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:53.074 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T12:14:53.088 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:14:53.175 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-28T12:14:53.189 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-28T12:14:53.276 INFO:teuthology.orchestra.console.smithi186:Power on 2023-11-28T12:14:53.276 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T12:14:53.290 INFO:teuthology.orchestra.console.smithi156:Power on 2023-11-28T12:14:53.290 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T12:14:53.298 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-11-28T12:14:53.299 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:53.314 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-11-28T12:14:53.314 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:53.322 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T12:14:53.338 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:14:57.326 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:57.338 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:14:57.435 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T12:14:57.447 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:15:01.438 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:15:01.448 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:15:01.547 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T12:15:01.556 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-28T12:15:01.649 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-11-28T12:15:01.658 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-11-28T12:15:01.750 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-11-28T12:15:01.758 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-11-28T12:17:47.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:17:47.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:17:50.822 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:17:50.822 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:17:56.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:17:56.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:17:59.906 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:17:59.906 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:18:05.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:05.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:08.969 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:18:08.969 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:18:14.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:14.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:18.054 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:18:18.343 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:18:24.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:24.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:27.430 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:18:27.431 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:18:33.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:33.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:36.518 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:18:36.518 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:18:42.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:42.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:45.606 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:18:45.607 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:18:51.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:51.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:18:54.694 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:18:54.694 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:19:00.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:19:00.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:20:00.763 WARNING:teuthology.provision.fog.smithi156:timed out 2023-11-28T12:20:00.763 WARNING:teuthology.provision.fog.smithi186:timed out 2023-11-28T12:20:06.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:20:06.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:20:07.067 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T12:20:07.067 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T12:20:07.078 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T12:20:07.078 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T12:20:07.308 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-11-28T12:20:07.308 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-11-28T12:20:07.323 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-11-28T12:20:07.324 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-11-28T12:20:07.340 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-11-28T12:20:07.341 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-11-28T12:20:07.378 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-11-28T12:20:07.378 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-28T12:20:07.396 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-11-28T12:20:07.397 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-11-28T12:20:07.453 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-11-28T12:20:07.453 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-28T12:20:07.481 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-11-28T12:20:07.507 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-11-28T12:20:07.568 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-11-28T12:20:07.571 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-11-28T12:20:07.595 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-11-28T12:20:07.635 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-28T12:20:07.661 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-11-28T12:20:07.698 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-28T12:20:07.726 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-28T12:20:07.752 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:20:07.752 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.4 (Ootpa)" 2023-11-28T12:20:07.752 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.4" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-28T12:20:07.753 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:20:07.754 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-28T12:20:07.754 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-11-28T12:20:07.755 DEBUG:teuthology.parallel:result is None 2023-11-28T12:20:07.789 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-28T12:20:07.844 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:20:07.844 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.4 (Ootpa)" 2023-11-28T12:20:07.844 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-11-28T12:20:07.844 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.4" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:20:07.845 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-28T12:20:07.846 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-11-28T12:20:07.846 DEBUG:teuthology.parallel:result is None 2023-11-28T12:20:08.018 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-11-28T12:20:08.018 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T12:20:08.042 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-11-28T12:20:08.042 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T12:20:08.068 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-11-28T12:20:08.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-28T12:20:08.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:20:08.132 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-28T12:20:08.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-28T12:20:08.200 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-28T12:20:08.253 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-28T12:20:08.253 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.4 (Ootpa)" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.4" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-28T12:20:08.307 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:20:08.308 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-28T12:20:08.309 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-28T12:20:08.333 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-11-28T12:20:08.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-28T12:20:08.334 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:20:08.400 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-28T12:20:08.471 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-28T12:20:08.471 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-28T12:20:08.526 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-28T12:20:08.527 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-28T12:20:08.582 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.4 (Ootpa)" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.4" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:20:08.583 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-28T12:20:08.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:20:08.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-11-28T12:20:08.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:20:08.584 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-11-28T12:20:08.584 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-28T12:20:08.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:20:08.695 INFO:teuthology.dispatcher.supervisor:Running job 7469217 2023-11-28T12:20:08.695 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-27_22:36:50-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7469217 --name yuriw-2023-11-27_22:36:50-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi --description rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} -- /home/teuthworker/archive/yuriw-2023-11-27_22:36:50-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7469217/orig.config.yaml 2023-11-28T12:20:08.698 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-27_22:36:50-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7469217 2023-11-28T12:20:08.699 INFO:teuthology.dispatcher.supervisor:Job PID: 2855963 2023-11-28T12:20:08.699 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T12:22:08.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:24:08.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:26:09.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:28:09.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:30:09.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:32:09.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:34:09.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:36:09.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:38:14.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:40:14.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:42:14.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:42:14.458 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T12:42:14.558 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T12:42:14.559 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T12:42:14.607 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-28T12:42:14.608 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:42:14.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:50-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7469217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:14:43.394582', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIPJLGyt6aYrascUOKxFgc4KDwaFghz9hz4Rre2nvJtmQMouKCd6nBXUgF9+dq6XqMKjuHrvvCTIOTEivXB9klU='} 2023-11-28T12:42:14.632 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-28T12:42:14.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T12:42:14.656 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-27_22:36:50-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7469217', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:14:43.396486', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC24zl+8pO+yx4U+uMWzS1NP6rlH8z7fbSCe2TpxRrUrsmDptNB7pjE06eQym32/pfDpxZUgN7y4LEplGez3yFE='} 2023-11-28T12:42:14.678 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-28T12:42:14.679 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:42:14.699 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-28T12:42:14.699 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:14.715 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-28T12:42:14.716 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:42:14.726 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:42:14.740 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-28T12:42:14.740 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:14.761 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T12:42:14.827 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-28T12:42:14.862 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-28T12:42:14.983 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-11-28T12:42:15.008 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com