2023-12-13T23:10:55.502 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-13T23:10:55.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:10:55.648 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f776d378940>, signals=[15]) 2023-12-13T23:10:55.649 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2023-12-13T23:10:55.649 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:10:55.650 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-12-13T23:10:55.675 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-12-13T23:10:55.675 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-12-13T23:10:55.675 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-13T23:10:55.783 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:10:55.812 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-13T23:10:55.827 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of rhel 8.6 2023-12-13T23:10:55.864 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6 2023-12-13T23:10:56.090 INFO:teuthology.orchestra.console.smithi005:Power off 2023-12-13T23:10:56.091 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:10:56.128 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-12-13T23:10:56.128 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:10:56.155 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-13T23:10:56.156 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:10:56.165 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-12-13T23:10:56.186 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-13T23:10:56.186 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:10:56.212 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T23:11:00.169 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:00.213 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:00.279 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-12-13T23:11:00.322 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T23:11:04.281 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:04.323 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:04.391 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-12-13T23:11:04.432 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T23:11:04.492 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-12-13T23:11:04.593 INFO:teuthology.orchestra.console.smithi005:Power on 2023-12-13T23:11:04.593 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:11:04.614 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2023-12-13T23:11:04.615 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:04.636 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-12-13T23:11:08.433 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:08.544 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T23:11:08.637 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:08.645 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-13T23:11:08.746 INFO:teuthology.orchestra.console.smithi088:Power on 2023-12-13T23:11:08.746 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-13T23:11:08.757 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-12-13T23:11:08.770 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2023-12-13T23:11:08.770 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:08.797 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T23:11:12.761 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:12.798 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:12.870 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2023-12-13T23:11:12.909 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T23:11:12.971 INFO:teuthology.orchestra.console.smithi005:Power on completed 2023-12-13T23:11:13.072 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2023-12-13T23:11:16.913 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:11:17.022 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-12-13T23:11:17.123 INFO:teuthology.orchestra.console.smithi088:Power on completed 2023-12-13T23:11:17.224 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-12-13T23:13:43.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:13:47.026 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-12-13T23:13:53.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:13:56.114 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-12-13T23:14:02.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:05.169 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-12-13T23:14:11.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:14.225 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-12-13T23:14:18.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:20.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:21.202 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:14:23.282 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2023-12-13T23:14:27.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:29.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:30.261 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:14:36.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:39.345 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:14:45.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:48.405 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:14:54.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:14:57.489 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:15:03.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:15:06.545 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:15:12.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:15:15.601 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-12-13T23:15:21.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:15:29.294 WARNING:teuthology.provision.fog.smithi005:timed out 2023-12-13T23:15:35.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:15:35.650 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:15:35.651 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:15:35.946 INFO:teuthology.provision.fog.smithi005:Node is ready 2023-12-13T23:15:35.947 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2023-12-13T23:15:35.966 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2023-12-13T23:15:35.966 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2023-12-13T23:15:36.025 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2023-12-13T23:15:36.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-12-13T23:15:36.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2023-12-13T23:15:36.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2023-12-13T23:15:36.244 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2023-12-13T23:15:36.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2023-12-13T23:15:36.380 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:15:36.438 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:15:36.439 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:15:36.440 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2023-12-13T23:15:36.442 DEBUG:teuthology.parallel:result is None 2023-12-13T23:16:21.650 WARNING:teuthology.provision.fog.smithi088:timed out 2023-12-13T23:16:27.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:16:28.084 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-13T23:16:28.085 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-13T23:16:28.354 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-12-13T23:16:28.355 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2023-12-13T23:16:28.372 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2023-12-13T23:16:28.373 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2023-12-13T23:16:28.431 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-12-13T23:16:28.431 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-12-13T23:16:28.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2023-12-13T23:16:28.570 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2023-12-13T23:16:28.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2023-12-13T23:16:28.705 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2023-12-13T23:16:28.771 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-12-13T23:16:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:16:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:16:28.829 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-12-13T23:16:28.830 DEBUG:teuthology.parallel:result is None 2023-12-13T23:16:28.983 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2023-12-13T23:16:28.984 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T23:16:29.004 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-12-13T23:16:29.004 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-13T23:16:29.031 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:16:29.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-12-13T23:16:29.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:16:29.101 DEBUG:teuthology.orchestra.run.smithi005:> true 2023-12-13T23:16:29.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2023-12-13T23:16:29.241 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2023-12-13T23:16:29.301 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2023-12-13T23:16:29.301 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2023-12-13T23:16:29.361 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:16:29.361 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:16:29.361 INFO:teuthology.orchestra.run.smithi005.stdout:ID="rhel" 2023-12-13T23:16:29.361 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="fedora" 2023-12-13T23:16:29.362 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8.6" 2023-12-13T23:16:29.362 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:16:29.362 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:16:29.362 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2023-12-13T23:16:29.363 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:16:29.363 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:16:29.363 INFO:teuthology.orchestra.run.smithi005.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:16:29.363 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:16:29.363 INFO:teuthology.orchestra.run.smithi005.stdout: 2023-12-13T23:16:29.364 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:16:29.364 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:16:29.364 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:16:29.364 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:16:29.365 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2023-12-13T23:16:29.388 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-12-13T23:16:29.388 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-13T23:16:29.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-13T23:16:29.456 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-12-13T23:16:29.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-12-13T23:16:29.525 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-12-13T23:16:29.584 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-12-13T23:16:29.584 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-12-13T23:16:29.643 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-12-13T23:16:29.643 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-12-13T23:16:29.643 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-12-13T23:16:29.643 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-12-13T23:16:29.643 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-12-13T23:16:29.644 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-12-13T23:16:29.644 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-13T23:16:29.644 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-12-13T23:16:29.644 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-13T23:16:29.644 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-12-13T23:16:29.644 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-13T23:16:29.645 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-13T23:16:29.645 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-12-13T23:16:29.645 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-13T23:16:29.645 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-13T23:16:29.645 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-13T23:16:29.646 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-13T23:16:29.646 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-12-13T23:16:29.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:16:29.769 INFO:teuthology.dispatcher.supervisor:Running job 7490628 2023-12-13T23:16:29.769 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490628 --name yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_pjd}} -- /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490628/orig.config.yaml 2023-12-13T23:16:29.773 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490628 2023-12-13T23:16:29.774 INFO:teuthology.dispatcher.supervisor:Job PID: 1842151 2023-12-13T23:16:29.774 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-13T23:18:29.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:20:30.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:22:30.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:24:30.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-13T23:24:30.487 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-13T23:24:30.606 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-13T23:24:30.606 INFO:teuthology.nuke:Checking targets against current locks 2023-12-13T23:24:30.653 DEBUG:teuthology.nuke:shortname: smithi005 2023-12-13T23:24:30.654 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:24:30.677 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:10:54.678397', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T23:24:30.680 DEBUG:teuthology.nuke:shortname: smithi088 2023-12-13T23:24:30.680 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-13T23:24:30.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:38:28-fs-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490628', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-13 23:10:54.676981', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-13T23:24:30.732 INFO:teuthology.orchestra.console.smithi005:Power off 2023-12-13T23:24:30.732 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:24:30.763 INFO:teuthology.orchestra.console.smithi088:Power off 2023-12-13T23:24:30.763 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-13T23:24:30.772 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2023-12-13T23:24:30.772 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:24:30.783 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-12-13T23:24:30.783 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-13T23:24:30.793 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2023-12-13T23:24:30.803 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-12-13T23:24:30.894 INFO:teuthology.orchestra.console.smithi005:Power off completed 2023-12-13T23:24:30.904 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-12-13T23:24:31.044 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2023-12-13T23:24:31.052 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com