2023-12-19T15:01:31.529 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T15:01:31.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:01:31.683 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd9d036c940>, signals=[15]) 2023-12-19T15:01:31.684 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-12-19T15:01:31.684 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:01:31.684 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-12-19T15:01:31.710 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-12-19T15:01:31.710 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-12-19T15:01:31.710 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-19T15:01:31.826 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:01:31.858 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-19T15:01:31.870 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.4 2023-12-19T15:01:31.901 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.4 2023-12-19T15:01:32.110 INFO:teuthology.orchestra.console.smithi033:Power off 2023-12-19T15:01:32.110 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:01:32.137 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-12-19T15:01:32.137 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:32.162 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-19T15:01:32.163 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:01:32.176 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-19T15:01:32.189 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-19T15:01:32.190 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:32.217 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T15:01:32.278 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-12-19T15:01:32.319 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-19T15:01:32.379 INFO:teuthology.orchestra.console.smithi033:Power on 2023-12-19T15:01:32.379 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:01:32.413 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-12-19T15:01:32.413 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:32.421 INFO:teuthology.orchestra.console.smithi124:Power on 2023-12-19T15:01:32.421 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-19T15:01:32.435 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-19T15:01:32.450 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-12-19T15:01:32.451 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:32.477 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T15:01:36.441 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:36.477 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:36.551 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-12-19T15:01:36.587 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T15:01:36.653 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-12-19T15:01:36.754 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-12-19T15:01:40.589 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:01:40.699 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-12-19T15:01:40.799 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-12-19T15:01:40.900 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-12-19T15:04:07.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:10.641 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-19T15:04:16.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:19.697 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-19T15:04:25.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:26.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:28.757 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-19T15:04:29.777 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T15:04:34.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:35.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:37.845 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-19T15:04:38.833 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T15:04:43.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:44.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:46.929 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-12-19T15:04:47.893 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T15:04:52.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:53.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:04:56.981 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T15:05:02.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:05:06.065 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T15:05:12.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:05:15.125 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-12-19T15:05:21.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:05:52.970 WARNING:teuthology.provision.fog.smithi033:timed out 2023-12-19T15:05:58.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:05:59.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:05:59.301 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:05:59.577 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-12-19T15:05:59.577 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-12-19T15:05:59.593 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-12-19T15:05:59.594 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-12-19T15:05:59.650 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-12-19T15:05:59.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-12-19T15:05:59.774 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-12-19T15:05:59.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-12-19T15:05:59.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-12-19T15:05:59.936 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-12-19T15:06:00.002 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-12-19T15:06:00.058 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:06:00.058 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:06:00.058 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-12-19T15:06:00.058 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-12-19T15:06:00.058 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4" 2023-12-19T15:06:00.058 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:06:00.059 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:06:00.060 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-12-19T15:06:00.062 DEBUG:teuthology.parallel:result is None 2023-12-19T15:06:21.153 WARNING:teuthology.provision.fog.smithi124:timed out 2023-12-19T15:06:27.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:06:27.566 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-19T15:06:27.567 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-19T15:06:27.859 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-12-19T15:06:27.859 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-12-19T15:06:27.875 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-12-19T15:06:27.875 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-12-19T15:06:27.932 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-12-19T15:06:27.932 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-12-19T15:06:28.044 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-12-19T15:06:28.070 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-12-19T15:06:28.135 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-12-19T15:06:28.199 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-12-19T15:06:28.263 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:06:28.319 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:06:28.320 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:06:28.320 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-12-19T15:06:28.321 DEBUG:teuthology.parallel:result is None 2023-12-19T15:06:28.504 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-12-19T15:06:28.504 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:06:28.527 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-12-19T15:06:28.527 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-19T15:06:28.545 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:06:28.545 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-12-19T15:06:28.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:06:28.616 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-12-19T15:06:28.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-12-19T15:06:28.737 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-12-19T15:06:28.793 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-12-19T15:06:28.794 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-12-19T15:06:28.849 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:06:28.849 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:06:28.849 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-12-19T15:06:28.849 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:06:28.850 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:06:28.851 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-12-19T15:06:28.868 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-12-19T15:06:28.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-19T15:06:28.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T15:06:28.936 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-12-19T15:06:29.003 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-12-19T15:06:29.004 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-12-19T15:06:29.059 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-12-19T15:06:29.059 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-19T15:06:29.114 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-19T15:06:29.115 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-19T15:06:29.116 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-12-19T15:06:29.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:06:29.237 INFO:teuthology.dispatcher.supervisor:Running job 7496962 2023-12-19T15:06:29.237 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496962 --name rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496962/orig.config.yaml 2023-12-19T15:06:29.243 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496962 2023-12-19T15:06:29.243 INFO:teuthology.dispatcher.supervisor:Job PID: 2595253 2023-12-19T15:06:29.243 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-19T15:08:29.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:10:29.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:12:29.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:14:29.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:16:30.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:18:30.192 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:20:30.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T15:20:30.417 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-19T15:20:30.541 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-19T15:20:30.541 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T15:20:30.593 DEBUG:teuthology.nuke:shortname: smithi033 2023-12-19T15:20:30.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:20:30.620 DEBUG:teuthology.nuke:shortname: smithi124 2023-12-19T15:20:30.620 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T15:20:30.625 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496962', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:01:30.664223', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDu9NUTite970xDGfj2xINe2OElG8f+FwMMMi6SysyA1VX1+FkLL1nj70W4CJd8cMkjo+egeMM3Hhf21SMiDc7Y='} 2023-12-19T15:20:30.649 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_12:25:28-fs-rishabh-mdscap-quincy-testing-default-smithi/7496962', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 15:01:30.662658', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOBkzawGmznHxN0grSweu+kG9++iA58HkuGZlfBmQq1rMjAikoEdy7S3wZ8DyvsiMpomFSN3uTyWtwoezrG5UVQ='} 2023-12-19T15:20:30.684 INFO:teuthology.orchestra.console.smithi033:Power off 2023-12-19T15:20:30.684 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:20:30.730 INFO:teuthology.orchestra.console.smithi124:Power off 2023-12-19T15:20:30.730 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T15:20:30.746 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-12-19T15:20:30.747 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:20:30.763 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-12-19T15:20:30.764 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T15:20:30.773 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-12-19T15:20:30.791 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-12-19T15:20:30.875 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-12-19T15:20:30.892 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-12-19T15:20:31.028 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-12-19T15:20:31.093 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com