2023-12-14T15:54:18.871 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T15:54:18.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:54:19.083 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd54fd44940>, signals=[15]) 2023-12-14T15:54:19.084 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-12-14T15:54:19.084 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T15:54:19.084 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-14T15:54:19.112 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-12-14T15:54:19.112 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T15:54:19.112 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-14T15:54:19.231 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T15:54:19.254 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T15:54:19.273 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.4 2023-12-14T15:54:19.306 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.4 2023-12-14T15:54:19.558 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-14T15:54:19.559 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:54:19.603 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-14T15:54:19.604 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T15:54:19.626 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-14T15:54:19.626 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:19.646 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-14T15:54:19.646 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:19.660 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-14T15:54:19.674 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-14T15:54:19.762 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-14T15:54:19.775 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-14T15:54:19.863 INFO:teuthology.orchestra.console.smithi102:Power on 2023-12-14T15:54:19.863 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T15:54:19.876 INFO:teuthology.orchestra.console.smithi124:Power on 2023-12-14T15:54:19.877 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T15:54:19.886 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-12-14T15:54:19.886 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:19.899 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-12-14T15:54:19.899 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:19.908 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-14T15:54:19.926 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-14T15:54:23.913 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:23.927 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:24.029 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-14T15:54:24.037 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-14T15:54:24.130 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-12-14T15:54:24.231 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-12-14T15:54:28.041 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T15:54:28.183 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-14T15:54:28.284 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-12-14T15:54:28.385 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-12-14T15:57:10.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:13.301 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:57:14.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:17.330 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-14T15:57:19.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:22.389 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:57:23.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:26.385 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-14T15:57:28.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:31.478 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:57:32.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:35.441 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-14T15:57:37.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:40.561 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:57:41.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:44.498 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-14T15:57:46.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:49.621 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:57:50.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:53.553 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-14T15:57:55.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:57:58.709 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:57:59.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:58:04.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:58:07.797 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-14T15:58:13.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:58:59.606 WARNING:teuthology.provision.fog.smithi124:timed out 2023-12-14T15:59:05.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:59:06.002 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T15:59:06.003 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T15:59:06.254 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-12-14T15:59:06.254 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-12-14T15:59:06.310 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-12-14T15:59:06.310 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-12-14T15:59:06.366 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-12-14T15:59:06.367 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-12-14T15:59:06.485 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-12-14T15:59:06.510 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-12-14T15:59:06.575 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-12-14T15:59:06.641 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-12-14T15:59:06.705 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-14T15:59:06.759 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:59:06.759 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:59:06.759 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-12-14T15:59:06.759 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:59:06.760 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:59:06.761 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-12-14T15:59:06.762 DEBUG:teuthology.parallel:result is None 2023-12-14T15:59:13.812 WARNING:teuthology.provision.fog.smithi102:timed out 2023-12-14T15:59:19.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:59:20.083 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T15:59:20.083 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T15:59:20.368 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-12-14T15:59:20.368 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-12-14T15:59:20.384 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-12-14T15:59:20.384 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-12-14T15:59:20.441 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-12-14T15:59:20.441 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-12-14T15:59:20.551 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-12-14T15:59:20.577 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-12-14T15:59:20.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-12-14T15:59:20.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-12-14T15:59:20.772 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-14T15:59:20.826 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:59:20.827 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-14T15:59:20.828 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:59:20.828 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:59:20.828 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:59:20.828 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:59:20.828 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-12-14T15:59:20.829 DEBUG:teuthology.parallel:result is None 2023-12-14T15:59:21.022 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-12-14T15:59:21.023 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T15:59:21.049 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-12-14T15:59:21.049 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T15:59:21.067 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-12-14T15:59:21.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-14T15:59:21.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:59:21.135 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-12-14T15:59:21.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-14T15:59:21.200 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-12-14T15:59:21.253 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-12-14T15:59:21.253 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-14T15:59:21.307 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.4" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-14T15:59:21.308 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:59:21.309 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:59:21.309 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:59:21.309 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:59:21.309 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-14T15:59:21.333 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-12-14T15:59:21.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-14T15:59:21.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T15:59:21.402 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-12-14T15:59:21.521 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-14T15:59:21.522 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-12-14T15:59:21.577 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-12-14T15:59:21.578 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-12-14T15:59:21.636 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T15:59:21.637 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T15:59:21.638 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-14T15:59:21.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T15:59:21.757 INFO:teuthology.dispatcher.supervisor:Running job 7491369 2023-12-14T15:59:21.757 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491369 --name yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_suites_pjd} -- /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491369/orig.config.yaml 2023-12-14T15:59:21.760 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491369 2023-12-14T15:59:21.761 INFO:teuthology.dispatcher.supervisor:Job PID: 634180 2023-12-14T15:59:21.761 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T16:01:21.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:03:22.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:05:22.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:07:22.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:07:22.447 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T16:07:22.556 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T16:07:22.556 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T16:07:22.600 DEBUG:teuthology.nuke:shortname: smithi102 2023-12-14T16:07:22.601 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T16:07:22.626 DEBUG:teuthology.nuke:shortname: smithi124 2023-12-14T16:07:22.626 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T16:07:22.629 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:54:17.901169', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHqTEMKhlMSo+mFZOU/BVQdTGWb7t2M0OcFvwfuDt3PJDx73gelJFjYU71hH5mtEv4rXzdNA8HqvZRMGfzsGzKA='} 2023-12-14T16:07:22.650 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491369', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 15:54:17.899147', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNCY5ckaYp/X2N0rNhEO2BP7Y2Yjq/Pe5S0MSUKxLkTi0SQ+SES38qjoQ/6e0VPOM4ZHoEyfVmjqYZDDt9JhtLM='} 2023-12-14T16:07:22.687 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-14T16:07:22.687 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:07:22.713 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-14T16:07:22.713 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:07:22.727 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-14T16:07:22.728 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:07:22.737 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-14T16:07:22.751 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-14T16:07:22.751 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:07:22.774 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-14T16:07:22.839 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-14T16:07:22.875 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-14T16:07:22.988 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-12-14T16:07:23.021 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com