2023-12-13T23:51:58.121 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T23:51:58.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:51:58.268 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7f468c0940>, signals=[15]) 2023-12-13T23:51:58.268 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2023-12-13T23:51:58.268 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:51:58.268 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-12-13T23:51:58.290 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-12-13T23:51:58.290 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:51:58.291 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-13T23:51:58.418 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:51:58.431 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:51:58.466 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of rhel 8.6 2023-12-13T23:51:58.476 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2023-12-13T23:51:58.787 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-13T23:51:58.787 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:51:58.800 INFO:teuthology.orchestra.console.smithi087:Power off 2023-12-13T23:51:58.800 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:51:58.809 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-13T23:51:58.810 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:51:58.822 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-12-13T23:51:58.822 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:51:58.833 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-13T23:51:58.846 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-12-13T23:51:58.937 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-13T23:51:58.947 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-12-13T23:51:59.039 INFO:teuthology.orchestra.console.smithi102:Power on 2023-12-13T23:51:59.039 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:51:59.049 INFO:teuthology.orchestra.console.smithi087:Power on 2023-12-13T23:51:59.049 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:51:59.065 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-12-13T23:51:59.065 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:51:59.073 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2023-12-13T23:51:59.073 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:51:59.088 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-13T23:51:59.097 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-12-13T23:52:03.089 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:52:03.098 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:52:03.201 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-12-13T23:52:03.209 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-12-13T23:52:03.302 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-12-13T23:52:03.403 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-12-13T23:52:07.213 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:52:07.322 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-12-13T23:52:07.423 INFO:teuthology.orchestra.console.smithi087:Power on completed 2023-12-13T23:52:07.523 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2023-12-13T23:54:38.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:54:41.649 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:54:47.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:54:49.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:54:50.705 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:54:52.721 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:54:56.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:54:58.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:54:59.761 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:55:01.777 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:55:05.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:07.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:08.821 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:55:10.833 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:55:14.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:16.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:17.905 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:55:19.893 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:55:23.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:25.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:26.965 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:55:28.977 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:55:32.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:34.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:36.049 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-12-13T23:55:38.037 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:55:42.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:44.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:55:47.121 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2023-12-13T23:55:53.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:56:42.102 WARNING:teuthology.provision.fog.smithi087:timed out 2023-12-13T23:56:48.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:56:48.486 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:56:48.487 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:56:48.761 INFO:teuthology.provision.fog.smithi087:Node is ready 2023-12-13T23:56:48.762 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2023-12-13T23:56:48.823 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087 2023-12-13T23:56:48.823 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087 /etc/hosts 2023-12-13T23:56:48.885 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2023-12-13T23:56:48.885 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-12-13T23:56:49.013 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087/smithi087/g' /etc/hosts 2023-12-13T23:56:49.044 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2023-12-13T23:56:49.116 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087/smithi087/g' /etc/hostname 2023-12-13T23:56:49.186 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-12-13T23:56:49.255 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-12-13T23:56:49.315 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:56:49.315 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:56:49.315 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2023-12-13T23:56:49.316 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2023-12-13T23:56:49.316 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.6" 2023-12-13T23:56:49.316 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:56:49.316 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:56:49.317 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-12-13T23:56:49.317 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:56:49.317 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:56:49.317 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:56:49.318 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:56:49.318 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-13T23:56:49.318 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:56:49.318 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:56:49.319 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:56:49.319 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:56:49.320 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2023-12-13T23:56:49.321 DEBUG:teuthology.parallel:result is None 2023-12-13T23:56:53.133 WARNING:teuthology.provision.fog.smithi102:timed out 2023-12-13T23:56:59.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:56:59.397 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:56:59.397 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:56:59.712 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-12-13T23:56:59.712 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-12-13T23:56:59.731 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102 2023-12-13T23:56:59.731 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102 /etc/hosts 2023-12-13T23:56:59.794 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-12-13T23:56:59.794 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-12-13T23:56:59.930 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102/smithi102/g' /etc/hosts 2023-12-13T23:56:59.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-12-13T23:57:00.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102/smithi102/g' /etc/hostname 2023-12-13T23:57:00.102 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-12-13T23:57:00.171 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-13T23:57:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:57:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:57:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-12-13T23:57:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-12-13T23:57:00.233 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-12-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:57:00.234 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:57:00.235 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:57:00.236 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:57:00.236 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-13T23:57:00.236 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:57:00.236 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:57:00.236 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:57:00.236 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:57:00.237 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-12-13T23:57:00.237 DEBUG:teuthology.parallel:result is None 2023-12-13T23:57:00.422 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2023-12-13T23:57:00.423 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T23:57:00.445 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-12-13T23:57:00.447 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:57:00.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-13T23:57:00.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:57:00.514 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-12-13T23:57:00.643 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-12-13T23:57:00.643 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-12-13T23:57:00.701 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-12-13T23:57:00.701 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:ID="rhel" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="fedora" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8.6" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:57:00.758 INFO:teuthology.orchestra.run.smithi087.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi087.stdout: 2023-12-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:57:00.759 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:57:00.759 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-12-13T23:57:00.779 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:57:00.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-13T23:57:00.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:57:00.850 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-12-13T23:57:00.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-12-13T23:57:00.919 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-12-13T23:57:00.980 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-12-13T23:57:00.980 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-12-13T23:57:01.040 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:57:01.040 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:57:01.040 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2023-12-13T23:57:01.040 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2023-12-13T23:57:01.040 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout: 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:57:01.041 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:57:01.042 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-12-13T23:57:01.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:57:01.184 INFO:teuthology.dispatcher.supervisor:Running job 7490692 2023-12-13T23:57:01.184 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490692 --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490692/orig.config.yaml 2023-12-13T23:57:01.188 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490692 2023-12-13T23:57:01.189 INFO:teuthology.dispatcher.supervisor:Job PID: 2447425 2023-12-13T23:57:01.189 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T23:59:01.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:01:01.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:03:01.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:05:01.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T00:05:01.858 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T00:05:01.986 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T00:05:01.986 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T00:05:02.039 DEBUG:teuthology.nuke:shortname: smithi087 2023-12-14T00:05:02.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T00:05:02.065 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:51:57.199038', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-14T00:05:02.069 DEBUG:teuthology.nuke:shortname: smithi102 2023-12-14T00:05:02.069 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T00:05:02.094 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490692', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:51:57.197612', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-14T00:05:02.124 INFO:teuthology.orchestra.console.smithi087:Power off 2023-12-14T00:05:02.124 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T00:05:02.148 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-12-14T00:05:02.148 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T00:05:02.164 INFO:teuthology.orchestra.console.smithi102:Power off 2023-12-14T00:05:02.164 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T00:05:02.174 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-12-14T00:05:02.186 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-12-14T00:05:02.187 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T00:05:02.212 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-12-14T00:05:02.275 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-12-14T00:05:02.313 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-12-14T00:05:02.433 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com 2023-12-14T00:05:02.456 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com