2023-12-22T09:33:33.081 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-22T09:33:33.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:33:33.230 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd0463f1940>, signals=[15]) 2023-12-22T09:33:33.230 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2023-12-22T09:33:33.230 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T09:33:33.230 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-22T09:33:33.256 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2023-12-22T09:33:33.256 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2023-12-22T09:33:33.257 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-12-22T09:33:33.377 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-22T09:33:33.398 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-22T09:33:33.425 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of rhel 8.4 2023-12-22T09:33:33.440 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of rhel 8.4 2023-12-22T09:33:33.792 INFO:teuthology.orchestra.console.smithi137:Power off 2023-12-22T09:33:33.792 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:33:33.818 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2023-12-22T09:33:33.818 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:33.847 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-22T09:33:33.847 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:33:33.857 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-12-22T09:33:33.875 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-22T09:33:33.876 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:33.904 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-22T09:33:33.958 INFO:teuthology.orchestra.console.smithi137:Power off completed 2023-12-22T09:33:34.005 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-22T09:33:34.060 INFO:teuthology.orchestra.console.smithi137:Power on 2023-12-22T09:33:34.060 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T09:33:34.086 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2023-12-22T09:33:34.087 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:34.106 INFO:teuthology.orchestra.console.smithi053:Power on 2023-12-22T09:33:34.106 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-22T09:33:34.120 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-12-22T09:33:34.133 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2023-12-22T09:33:34.133 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:34.158 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-22T09:33:38.124 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:38.159 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:38.237 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-12-22T09:33:38.270 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-12-22T09:33:38.370 INFO:teuthology.orchestra.console.smithi053:Power on completed 2023-12-22T09:33:38.471 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2023-12-22T09:33:42.242 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:33:42.354 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2023-12-22T09:33:42.455 INFO:teuthology.orchestra.console.smithi137:Power on completed 2023-12-22T09:33:42.556 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2023-12-22T09:36:09.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:12.597 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-22T09:36:18.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:21.681 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-22T09:36:27.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:28.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:30.741 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-22T09:36:31.765 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-12-22T09:36:36.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:37.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:39.825 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2023-12-22T09:36:40.818 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-12-22T09:36:45.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:46.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:49.874 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-12-22T09:36:55.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:36:58.929 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-12-22T09:37:04.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:37:08.022 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-12-22T09:37:14.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:37:17.112 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2023-12-22T09:37:23.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:37:45.854 WARNING:teuthology.provision.fog.smithi053:timed out 2023-12-22T09:37:51.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:37:52.170 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T09:37:52.170 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T09:37:52.417 INFO:teuthology.provision.fog.smithi053:Node is ready 2023-12-22T09:37:52.417 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2023-12-22T09:37:52.473 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2023-12-22T09:37:52.474 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2023-12-22T09:37:52.530 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2023-12-22T09:37:52.530 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-12-22T09:37:52.645 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2023-12-22T09:37:52.672 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2023-12-22T09:37:52.738 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2023-12-22T09:37:52.805 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2023-12-22T09:37:52.870 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:37:52.926 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:37:52.927 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:37:52.928 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2023-12-22T09:37:52.929 DEBUG:teuthology.parallel:result is None 2023-12-22T09:38:23.150 WARNING:teuthology.provision.fog.smithi137:timed out 2023-12-22T09:38:29.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:38:29.440 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-22T09:38:29.440 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-22T09:38:29.695 INFO:teuthology.provision.fog.smithi137:Node is ready 2023-12-22T09:38:29.695 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2023-12-22T09:38:29.753 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2023-12-22T09:38:29.754 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2023-12-22T09:38:29.812 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2023-12-22T09:38:29.813 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-12-22T09:38:29.935 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2023-12-22T09:38:29.960 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2023-12-22T09:38:30.027 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2023-12-22T09:38:30.094 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2023-12-22T09:38:30.161 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-12-22T09:38:30.218 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:38:30.218 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.4" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-12-22T09:38:30.219 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:38:30.220 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:38:30.220 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:38:30.220 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:38:30.220 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2023-12-22T09:38:30.221 DEBUG:teuthology.parallel:result is None 2023-12-22T09:38:30.372 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2023-12-22T09:38:30.373 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T09:38:30.407 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2023-12-22T09:38:30.408 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-22T09:38:30.433 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2023-12-22T09:38:30.434 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-22T09:38:30.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:38:30.501 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-12-22T09:38:30.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-12-22T09:38:30.629 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-12-22T09:38:30.685 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-12-22T09:38:30.685 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-12-22T09:38:30.740 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:38:30.740 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:38:30.740 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-12-22T09:38:30.740 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-12-22T09:38:30.740 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.4" 2023-12-22T09:38:30.740 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:38:30.741 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:38:30.742 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-12-22T09:38:30.766 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2023-12-22T09:38:30.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-12-22T09:38:30.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-22T09:38:30.836 DEBUG:teuthology.orchestra.run.smithi137:> true 2023-12-22T09:38:30.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2023-12-22T09:38:30.903 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2023-12-22T09:38:30.960 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2023-12-22T09:38:30.961 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="Red Hat Enterprise Linux" 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8.4 (Ootpa)" 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:ID="rhel" 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="fedora" 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8.4" 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2023-12-22T09:38:31.018 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://www.redhat.com/" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout: 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-22T09:38:31.019 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-22T09:38:31.020 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2023-12-22T09:38:31.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:38:31.132 INFO:teuthology.dispatcher.supervisor:Running job 7499473 2023-12-22T09:38:31.132 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-12-22_08:14:05-fs-rishabh-mdscap-quincy-testing-default-smithi/7499473 --name rishabh-2023-12-22_08:14:05-fs-rishabh-mdscap-quincy-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/3 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/rishabh-2023-12-22_08:14:05-fs-rishabh-mdscap-quincy-testing-default-smithi/7499473/orig.config.yaml 2023-12-22T09:38:31.135 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-12-22_08:14:05-fs-rishabh-mdscap-quincy-testing-default-smithi/7499473 2023-12-22T09:38:31.136 INFO:teuthology.dispatcher.supervisor:Job PID: 2447296 2023-12-22T09:38:31.136 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-22T09:40:31.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:42:31.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:44:31.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:46:31.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:48:31.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:50:32.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:52:32.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-22T09:52:32.338 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-22T09:52:32.460 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-22T09:52:32.461 INFO:teuthology.nuke:Checking targets against current locks 2023-12-22T09:52:32.518 DEBUG:teuthology.nuke:shortname: smithi053 2023-12-22T09:52:32.519 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T09:52:32.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:14:05-fs-rishabh-mdscap-quincy-testing-default-smithi/7499473', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:33:32.207349', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP5PWMtmF8sKijMCsbXn06XFnqztMvLjAkLOL+nl6tVjNy7Cuie/8+2zYtXpidSFLGF9WjXBpLJm8SCHM1hLsYs='} 2023-12-22T09:52:32.542 DEBUG:teuthology.nuke:shortname: smithi137 2023-12-22T09:52:32.542 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-22T09:52:32.568 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi137.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-22_08:14:05-fs-rishabh-mdscap-quincy-testing-default-smithi/7499473', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-22 09:33:32.205478', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNJVOMQWcUu+tk4jkUnE5HFZzAWuJPeaFhbygfKNmdJcec3hZmxPlJUCOoqQzyI3mBby7zWbH6i4Hb4cdEZjBB0='} 2023-12-22T09:52:32.601 INFO:teuthology.orchestra.console.smithi053:Power off 2023-12-22T09:52:32.602 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:52:32.632 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-12-22T09:52:32.632 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:52:32.645 INFO:teuthology.orchestra.console.smithi137:Power off 2023-12-22T09:52:32.646 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-22T09:52:32.658 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-12-22T09:52:32.670 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2023-12-22T09:52:32.671 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-22T09:52:32.696 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2023-12-22T09:52:32.759 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-12-22T09:52:32.797 INFO:teuthology.orchestra.console.smithi137:Power off completed 2023-12-22T09:52:32.911 INFO:teuthology.lock.ops:unlocked: smithi053.front.sepia.ceph.com 2023-12-22T09:52:32.945 INFO:teuthology.lock.ops:unlocked: smithi137.front.sepia.ceph.com