2023-11-28T12:42:18.268 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T12:42:18.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:42:18.410 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9245402e50>, signals=[15]) 2023-11-28T12:42:18.410 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-11-28T12:42:18.411 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T12:42:18.411 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-28T12:42:18.430 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-11-28T12:42:18.430 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-11-28T12:42:18.430 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-28T12:42:18.565 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T12:42:18.568 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-28T12:42:18.609 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of rhel 8.6 2023-11-28T12:42:18.612 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of rhel 8.6 2023-11-28T12:42:18.882 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-28T12:42:18.882 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:42:18.895 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-28T12:42:18.895 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T12:42:18.903 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-28T12:42:18.904 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:18.919 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-28T12:42:18.920 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:18.927 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T12:42:18.940 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:42:19.028 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-28T12:42:19.041 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-28T12:42:19.130 INFO:teuthology.orchestra.console.smithi186:Power on 2023-11-28T12:42:19.130 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T12:42:19.142 INFO:teuthology.orchestra.console.smithi156:Power on 2023-11-28T12:42:19.142 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-28T12:42:19.153 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-11-28T12:42:19.154 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:19.167 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-11-28T12:42:19.168 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:19.178 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T12:42:19.192 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:42:23.182 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:23.193 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:23.291 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-11-28T12:42:23.302 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T12:42:23.392 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-11-28T12:42:23.493 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-11-28T12:42:27.306 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T12:42:27.414 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-11-28T12:42:27.515 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-11-28T12:42:27.616 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-11-28T12:45:09.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:12.550 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:45:13.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:16.514 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:45:18.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:21.634 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:45:22.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:25.574 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:45:27.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:30.690 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:45:31.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:34.630 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:45:36.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:39.746 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:45:40.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:43.685 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:45:45.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:48.802 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:45:49.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:52.742 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:45:54.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:45:57.858 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:45:58.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:01.826 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:46:03.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:06.918 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:46:07.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:10.883 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-11-28T12:46:12.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:16.002 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:46:16.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:22.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:40.487 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:46:46.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:49.574 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-11-28T12:46:55.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:46:57.657 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T12:46:57.658 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T12:46:57.928 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-11-28T12:46:57.929 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-11-28T12:46:57.945 INFO:teuthology.orchestra.run.smithi186.stdout:smithi022 2023-11-28T12:46:57.945 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi022 /etc/hosts 2023-11-28T12:46:58.002 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-11-28T12:46:58.002 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-28T12:46:58.112 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hosts 2023-11-28T12:46:58.139 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.22/172.21.15.186/g' /etc/hosts 2023-11-28T12:46:58.205 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi022/smithi186/g' /etc/hostname 2023-11-28T12:46:58.272 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-11-28T12:46:58.338 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-28T12:46:58.394 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:46:58.395 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:46:58.396 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:46:58.396 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-28T12:46:58.396 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:46:58.396 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T12:46:58.396 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:46:58.396 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T12:46:58.397 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-11-28T12:46:58.398 DEBUG:teuthology.parallel:result is None 2023-11-28T12:47:16.906 WARNING:teuthology.provision.fog.smithi156:timed out 2023-11-28T12:47:22.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:47:23.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-28T12:47:23.326 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-28T12:47:23.620 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-11-28T12:47:23.620 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-11-28T12:47:23.638 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-11-28T12:47:23.639 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-11-28T12:47:23.697 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-11-28T12:47:23.698 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-28T12:47:23.823 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-11-28T12:47:23.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-11-28T12:47:23.921 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-11-28T12:47:23.989 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-11-28T12:47:24.056 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-28T12:47:24.112 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:47:24.112 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-28T12:47:24.113 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:47:24.114 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T12:47:24.114 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:47:24.114 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T12:47:24.114 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-11-28T12:47:24.115 DEBUG:teuthology.parallel:result is None 2023-11-28T12:47:24.296 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-11-28T12:47:24.296 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T12:47:24.325 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-11-28T12:47:24.325 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-28T12:47:24.342 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-11-28T12:47:24.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-28T12:47:24.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:47:24.408 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-11-28T12:47:24.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-11-28T12:47:24.475 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-11-28T12:47:24.531 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-11-28T12:47:24.532 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T12:47:24.588 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:47:24.589 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T12:47:24.590 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-11-28T12:47:24.620 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-11-28T12:47:24.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-28T12:47:24.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T12:47:24.687 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-11-28T12:47:24.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-11-28T12:47:24.820 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-11-28T12:47:24.877 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-11-28T12:47:24.877 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-11-28T12:47:24.934 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-28T12:47:24.935 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-11-28T12:47:24.936 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-28T12:47:24.936 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-28T12:47:24.936 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-28T12:47:24.936 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-28T12:47:24.936 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-11-28T12:47:24.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:47:25.049 INFO:teuthology.dispatcher.supervisor:Running job 7469974 2023-11-28T12:47:25.049 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/bin/teuthology -v --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469974 --name neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/forward-scrub} -- /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469974/orig.config.yaml 2023-11-28T12:47:25.057 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469974 2023-11-28T12:47:25.057 INFO:teuthology.dispatcher.supervisor:Job PID: 3221989 2023-11-28T12:47:25.058 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-28T12:49:25.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:51:25.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:53:25.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:55:25.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:57:25.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T12:59:26.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:01:26.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:03:26.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:05:26.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:07:26.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:09:26.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:11:27.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:13:27.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:15:27.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:17:27.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T13:17:27.605 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-28T13:17:27.744 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-28T13:17:27.744 INFO:teuthology.nuke:Checking targets against current locks 2023-11-28T13:17:27.800 DEBUG:teuthology.nuke:shortname: smithi156 2023-11-28T13:17:27.801 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:17:27.822 DEBUG:teuthology.nuke:shortname: smithi186 2023-11-28T13:17:27.823 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T13:17:27.826 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:42:17.443992', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:17:27.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2023-11-28_12:38:30-fs-wip-neesingh-testing-231123-distro-default-smithi/7469974', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 12:42:17.445454', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-28T13:17:27.872 INFO:teuthology.orchestra.console.smithi156:Power off 2023-11-28T13:17:27.873 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:17:27.895 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-11-28T13:17:27.895 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:17:27.912 INFO:teuthology.orchestra.console.smithi186:Power off 2023-11-28T13:17:27.913 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-28T13:17:27.921 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-11-28T13:17:27.933 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-11-28T13:17:27.933 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-28T13:17:27.956 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-11-28T13:17:28.022 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-11-28T13:17:28.057 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-11-28T13:17:28.178 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2023-11-28T13:17:28.203 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com