2024-01-26T21:24:19.662 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-26T21:24:19.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:24:19.804 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb93b8c3c10>, signals=[15]) 2024-01-26T21:24:19.805 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2024-01-26T21:24:19.805 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2024-01-26T21:24:19.805 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-01-26T21:24:19.824 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2024-01-26T21:24:19.824 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2024-01-26T21:24:19.824 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-01-26T21:24:20.011 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-26T21:24:20.015 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-26T21:24:20.058 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6 2024-01-26T21:24:20.071 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of rhel 8.6 2024-01-26T21:24:20.299 INFO:teuthology.orchestra.console.smithi033:Power off 2024-01-26T21:24:20.300 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:24:20.313 INFO:teuthology.orchestra.console.smithi102:Power off 2024-01-26T21:24:20.313 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:24:20.331 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-01-26T21:24:20.331 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:20.340 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-01-26T21:24:20.341 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:20.356 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-26T21:24:20.362 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-01-26T21:24:20.457 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-01-26T21:24:20.558 INFO:teuthology.orchestra.console.smithi033:Power on 2024-01-26T21:24:20.558 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-26T21:24:20.580 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2024-01-26T21:24:20.580 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:20.602 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-26T21:24:24.364 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:24.475 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-01-26T21:24:24.603 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:24.711 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2024-01-26T21:24:24.812 INFO:teuthology.orchestra.console.smithi033:Power on completed 2024-01-26T21:24:24.912 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2024-01-26T21:24:28.477 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:28.587 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-26T21:24:28.688 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-01-26T21:24:28.789 INFO:teuthology.orchestra.console.smithi102:Power on 2024-01-26T21:24:28.789 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-26T21:24:28.814 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2024-01-26T21:24:28.814 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:28.841 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-26T21:24:32.844 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:32.955 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-26T21:24:36.958 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:24:37.066 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-01-26T21:24:37.167 INFO:teuthology.orchestra.console.smithi102:Power on completed 2024-01-26T21:24:37.268 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2024-01-26T21:26:55.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:26:58.652 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-26T21:27:04.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:07.708 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-26T21:27:13.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:16.764 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-26T21:27:22.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:23.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:25.820 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-26T21:27:26.140 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:27:31.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:32.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:34.908 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2024-01-26T21:27:35.196 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:27:40.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:41.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:44.252 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:27:50.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:27:53.308 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:27:59.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:28:02.368 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:28:08.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:28:11.452 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:28:17.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:28:20.508 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-26T21:28:26.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:28:40.928 WARNING:teuthology.provision.fog.smithi033:timed out 2024-01-26T21:28:46.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:28:47.172 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-26T21:28:47.172 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-26T21:28:47.449 INFO:teuthology.provision.fog.smithi033:Node is ready 2024-01-26T21:28:47.449 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2024-01-26T21:28:47.470 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2024-01-26T21:28:47.470 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2024-01-26T21:28:47.532 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2024-01-26T21:28:47.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-01-26T21:28:47.650 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2024-01-26T21:28:47.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2024-01-26T21:28:47.760 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2024-01-26T21:28:47.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2024-01-26T21:28:47.910 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-01-26T21:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2024-01-26T21:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2024-01-26T21:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2024-01-26T21:28:47.971 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:28:47.972 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:28:47.973 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2024-01-26T21:28:47.974 DEBUG:teuthology.parallel:result is None 2024-01-26T21:29:26.524 WARNING:teuthology.provision.fog.smithi102:timed out 2024-01-26T21:29:32.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:29:32.832 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-26T21:29:32.832 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-26T21:29:33.093 INFO:teuthology.provision.fog.smithi102:Node is ready 2024-01-26T21:29:33.093 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2024-01-26T21:29:33.110 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2024-01-26T21:29:33.111 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2024-01-26T21:29:33.172 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2024-01-26T21:29:33.173 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-01-26T21:29:33.282 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2024-01-26T21:29:33.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2024-01-26T21:29:33.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2024-01-26T21:29:33.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-01-26T21:29:33.523 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-01-26T21:29:33.583 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:29:33.584 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:29:33.584 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2024-01-26T21:29:33.585 DEBUG:teuthology.parallel:result is None 2024-01-26T21:29:33.736 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2024-01-26T21:29:33.736 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-26T21:29:33.763 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2024-01-26T21:29:33.763 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-26T21:29:33.788 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2024-01-26T21:29:33.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-01-26T21:29:33.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:29:33.866 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-01-26T21:29:34.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-01-26T21:29:34.012 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-01-26T21:29:34.074 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-01-26T21:29:34.074 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-01-26T21:29:34.134 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:29:34.134 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:29:34.134 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:29:34.135 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:29:34.136 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:29:34.136 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-01-26T21:29:34.154 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2024-01-26T21:29:34.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-26T21:29:34.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-26T21:29:34.231 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-01-26T21:29:34.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-26T21:29:34.297 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-01-26T21:29:34.354 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-01-26T21:29:34.355 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Red Hat Enterprise Linux" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8.6 (Ootpa)" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:ID="rhel" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="fedora" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8.6" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-01-26T21:29:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.redhat.com/" 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-26T21:29:34.413 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-26T21:29:34.413 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-01-26T21:29:34.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:29:34.531 INFO:teuthology.dispatcher.supervisor:Running job 7533240 2024-01-26T21:29:34.531 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533240 --name yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/osd 2-workunit/fs/trivial_sync}} -- /home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533240/orig.config.yaml 2024-01-26T21:29:34.534 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533240 2024-01-26T21:29:34.534 INFO:teuthology.dispatcher.supervisor:Job PID: 4017583 2024-01-26T21:29:34.534 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-26T21:31:34.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:33:34.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:35:34.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:37:35.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:39:35.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:41:35.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-26T21:41:35.490 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-26T21:41:35.594 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-26T21:41:35.594 INFO:teuthology.nuke:Checking targets against current locks 2024-01-26T21:41:35.641 DEBUG:teuthology.nuke:shortname: smithi033 2024-01-26T21:41:35.641 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-26T21:41:35.664 DEBUG:teuthology.nuke:shortname: smithi102 2024-01-26T21:41:35.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-26T21:41:35.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533240', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-26 21:24:18.579224', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF26MGoybBct7aL+fC3kMA061ADvMN1cAMPHpsWWGcCma6+sUbb6NA+/NtORP1be8lsLjFMGs+t7IMCCUO3H3qc='} 2024-01-26T21:41:35.690 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_01:05:00-fs-wip-yuri2-testing-2024-01-25-1327-reef-distro-default-smithi/7533240', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-26 21:24:18.580993', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCG1hYzCosbMFzDzlmeT7fEbzhh8Nh9Sf2jp30ZoU9AiZj1fmtC2aFu9Oiy4D3GIh+oP42oMbAhGu6jhyXT82Xg='} 2024-01-26T21:41:35.717 INFO:teuthology.orchestra.console.smithi033:Power off 2024-01-26T21:41:35.718 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:41:35.739 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2024-01-26T21:41:35.739 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:41:35.752 INFO:teuthology.orchestra.console.smithi102:Power off 2024-01-26T21:41:35.752 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-26T21:41:35.761 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2024-01-26T21:41:35.774 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-01-26T21:41:35.775 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-26T21:41:35.797 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-26T21:41:35.862 INFO:teuthology.orchestra.console.smithi033:Power off completed 2024-01-26T21:41:35.898 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-01-26T21:41:36.006 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2024-01-26T21:41:36.040 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com