2023-12-14T16:05:06.536 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T16:05:06.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:05:06.679 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5f75dde940>, signals=[15]) 2023-12-14T16:05:06.680 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-12-14T16:05:06.680 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T16:05:06.681 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-14T16:05:06.705 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2023-12-14T16:05:06.705 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T16:05:06.705 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-12-14T16:05:06.821 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T16:05:06.840 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T16:05:06.878 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.4 2023-12-14T16:05:06.884 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.4 2023-12-14T16:05:07.243 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-14T16:05:07.243 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:05:07.256 INFO:teuthology.orchestra.console.smithi084:Power off 2023-12-14T16:05:07.256 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:05:07.265 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-14T16:05:07.266 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:07.276 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-12-14T16:05:07.277 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:07.286 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T16:05:07.298 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-14T16:05:07.387 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-14T16:05:07.399 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-12-14T16:05:07.489 INFO:teuthology.orchestra.console.smithi037:Power on 2023-12-14T16:05:07.489 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T16:05:07.500 INFO:teuthology.orchestra.console.smithi084:Power on 2023-12-14T16:05:07.500 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T16:05:07.516 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-12-14T16:05:07.517 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:07.526 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2023-12-14T16:05:07.526 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:07.540 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T16:05:07.548 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-14T16:05:11.543 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:11.550 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:11.652 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T16:05:11.659 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2023-12-14T16:05:11.760 INFO:teuthology.orchestra.console.smithi084:Power on completed 2023-12-14T16:05:11.861 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2023-12-14T16:05:15.654 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:05:15.764 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-14T16:05:15.864 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-12-14T16:05:15.965 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-12-14T16:07:47.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:07:50.133 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:07:56.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:07:58.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:07:59.217 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:08:01.173 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-14T16:08:05.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:07.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:08.277 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:08:10.257 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-14T16:08:14.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:16.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:17.361 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:08:19.313 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-14T16:08:23.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:25.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:26.417 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:08:28.373 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-14T16:08:32.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:34.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:37.458 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2023-12-14T16:08:42.773 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:08:43.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:48.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:08:51.861 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:08:57.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:09:00.945 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:09:06.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:09:10.002 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T16:09:16.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:09:16.320 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T16:09:16.321 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T16:09:26.251 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-12-14T16:09:26.252 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-12-14T16:09:26.271 INFO:teuthology.orchestra.run.smithi037.stdout:smithi036 2023-12-14T16:09:26.272 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi036 /etc/hosts 2023-12-14T16:09:26.330 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-12-14T16:09:26.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-12-14T16:09:26.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi036/smithi037/g' /etc/hosts 2023-12-14T16:09:26.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.36/172.21.15.37/g' /etc/hosts 2023-12-14T16:09:26.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi036/smithi037/g' /etc/hostname 2023-12-14T16:09:26.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-12-14T16:09:26.701 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-14T16:09:26.757 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-14T16:09:26.758 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:09:26.759 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:09:26.759 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:09:26.759 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:09:26.759 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-12-14T16:09:26.761 DEBUG:teuthology.parallel:result is None 2023-12-14T16:09:43.478 WARNING:teuthology.provision.fog.smithi084:timed out 2023-12-14T16:09:49.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:09:49.862 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T16:09:49.862 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T16:09:50.120 INFO:teuthology.provision.fog.smithi084:Node is ready 2023-12-14T16:09:50.120 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2023-12-14T16:09:50.174 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084 2023-12-14T16:09:50.174 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084 /etc/hosts 2023-12-14T16:09:50.228 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2023-12-14T16:09:50.228 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-12-14T16:09:50.344 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084/smithi084/g' /etc/hosts 2023-12-14T16:09:50.369 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2023-12-14T16:09:50.432 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084/smithi084/g' /etc/hostname 2023-12-14T16:09:50.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2023-12-14T16:09:50.561 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.4" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:09:50.619 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:09:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:09:50.620 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-14T16:09:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:09:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:09:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:09:50.620 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:09:50.620 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2023-12-14T16:09:50.621 DEBUG:teuthology.parallel:result is None 2023-12-14T16:09:50.778 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-12-14T16:09:50.779 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T16:09:50.802 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2023-12-14T16:09:50.802 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T16:09:50.827 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-12-14T16:09:50.828 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-14T16:09:50.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:09:50.901 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-14T16:09:51.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-14T16:09:51.025 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-12-14T16:09:51.081 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-12-14T16:09:51.081 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-14T16:09:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:09:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:09:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-12-14T16:09:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:09:51.137 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:09:51.138 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-14T16:09:51.159 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2023-12-14T16:09:51.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-14T16:09:51.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T16:09:51.274 DEBUG:teuthology.orchestra.run.smithi084:> true 2023-12-14T16:09:51.295 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2023-12-14T16:09:51.295 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2023-12-14T16:09:51.354 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2023-12-14T16:09:51.354 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.4" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T16:09:51.412 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T16:09:51.413 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T16:09:51.413 INFO:teuthology.orchestra.run.smithi084.stdout: 2023-12-14T16:09:51.413 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T16:09:51.413 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T16:09:51.413 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T16:09:51.413 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T16:09:51.413 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2023-12-14T16:09:51.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:09:51.517 INFO:teuthology.dispatcher.supervisor:Running job 7491407 2023-12-14T16:09:51.518 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491407 --name yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mon 2-workunit/suites/fsstress}} -- /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491407/orig.config.yaml 2023-12-14T16:09:51.521 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491407 2023-12-14T16:09:51.522 INFO:teuthology.dispatcher.supervisor:Job PID: 882053 2023-12-14T16:09:51.522 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T16:11:51.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:13:51.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:15:51.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:17:52.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T16:17:52.201 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T16:17:52.321 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T16:17:52.322 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T16:17:52.372 DEBUG:teuthology.nuke:shortname: smithi037 2023-12-14T16:17:52.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T16:17:52.387 DEBUG:teuthology.nuke:shortname: smithi084 2023-12-14T16:17:52.387 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T16:17:52.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491407', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 16:05:05.666766', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwyqDPw3tasM4nfWypmQBo7J26Chhv3Iv3R6Z7ozoCQJ3ZANtdHKe8Yrr/8mIQ3fR6bnmDBsgP04FG221PMeLc='} 2023-12-14T16:17:52.406 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_15:21:40-fs-wip-vshankar-testing3-2023-12-13-1225-quincy-distro-default-smithi/7491407', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 16:05:05.667947', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB5SyOVePwIx6Th3ZGlWp/H135w1FJi377beSPp2b8xaLDPVWkd0tyA8kWf+7oiM9naH0jwOzvcReRMIs6WYb84='} 2023-12-14T16:17:52.446 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-14T16:17:52.446 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:17:52.461 INFO:teuthology.orchestra.console.smithi084:Power off 2023-12-14T16:17:52.461 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T16:17:52.469 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-14T16:17:52.470 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:17:52.486 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2023-12-14T16:17:52.487 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T16:17:52.496 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T16:17:52.509 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2023-12-14T16:17:52.598 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-14T16:17:52.610 INFO:teuthology.orchestra.console.smithi084:Power off completed 2023-12-14T16:17:52.749 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-12-14T16:17:52.759 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com