2024-01-13T04:25:21.061 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T04:25:21.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:25:21.214 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f296d47cc10>, signals=[15]) 2024-01-13T04:25:21.214 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2024-01-13T04:25:21.215 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T04:25:21.215 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-01-13T04:25:21.233 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2024-01-13T04:25:21.233 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T04:25:21.233 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-13T04:25:21.341 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T04:25:21.375 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T04:25:21.389 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of rhel 8.6 2024-01-13T04:25:21.438 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6 2024-01-13T04:25:21.683 INFO:teuthology.orchestra.console.smithi081:Power off 2024-01-13T04:25:21.683 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:25:21.704 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-01-13T04:25:21.704 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:21.717 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-13T04:25:21.718 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:25:21.725 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-01-13T04:25:21.737 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-13T04:25:21.737 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:21.757 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-13T04:25:21.827 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-01-13T04:25:21.858 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-13T04:25:21.928 INFO:teuthology.orchestra.console.smithi081:Power on 2024-01-13T04:25:21.928 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T04:25:21.949 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2024-01-13T04:25:21.950 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:21.959 INFO:teuthology.orchestra.console.smithi125:Power on 2024-01-13T04:25:21.959 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T04:25:21.971 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-01-13T04:25:21.978 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2024-01-13T04:25:21.979 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:21.999 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-13T04:25:25.976 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:26.000 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:26.084 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-01-13T04:25:26.108 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-01-13T04:25:26.209 INFO:teuthology.orchestra.console.smithi125:Power on completed 2024-01-13T04:25:26.309 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2024-01-13T04:25:30.086 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:25:30.249 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-01-13T04:25:30.349 INFO:teuthology.orchestra.console.smithi081:Power on completed 2024-01-13T04:25:30.450 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2024-01-13T04:28:12.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:15.388 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:28:16.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:19.517 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-01-13T04:28:21.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:24.444 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:28:25.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:28.572 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-01-13T04:28:30.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:33.500 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:28:34.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:37.628 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-01-13T04:28:39.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:42.560 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:28:43.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:46.684 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-01-13T04:28:48.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:51.644 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:28:52.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:28:55.740 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-01-13T04:28:57.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:29:00.700 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:29:01.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:29:04.796 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-01-13T04:29:06.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:29:09.756 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-01-13T04:29:10.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:29:15.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:30:10.852 WARNING:teuthology.provision.fog.smithi081:timed out 2024-01-13T04:30:15.764 WARNING:teuthology.provision.fog.smithi125:timed out 2024-01-13T04:30:16.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:30:17.157 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T04:30:17.157 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T04:30:17.459 INFO:teuthology.provision.fog.smithi081:Node is ready 2024-01-13T04:30:17.459 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2024-01-13T04:30:17.476 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 2024-01-13T04:30:17.477 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081 /etc/hosts 2024-01-13T04:30:17.533 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2024-01-13T04:30:17.533 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-01-13T04:30:17.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hosts 2024-01-13T04:30:17.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2024-01-13T04:30:17.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081/smithi081/g' /etc/hostname 2024-01-13T04:30:17.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-01-13T04:30:17.879 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-01-13T04:30:17.933 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T04:30:17.933 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T04:30:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T04:30:17.935 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2024-01-13T04:30:17.936 DEBUG:teuthology.parallel:result is None 2024-01-13T04:30:21.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:30:22.019 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T04:30:22.019 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T04:30:22.320 INFO:teuthology.provision.fog.smithi125:Node is ready 2024-01-13T04:30:22.320 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2024-01-13T04:30:22.338 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125 2024-01-13T04:30:22.339 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125 /etc/hosts 2024-01-13T04:30:22.394 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2024-01-13T04:30:22.394 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-01-13T04:30:22.503 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125/smithi125/g' /etc/hosts 2024-01-13T04:30:22.533 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2024-01-13T04:30:22.602 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125/smithi125/g' /etc/hostname 2024-01-13T04:30:22.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2024-01-13T04:30:22.735 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-13T04:30:22.790 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T04:30:22.790 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-13T04:30:22.791 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:30:22.792 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T04:30:22.792 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T04:30:22.792 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T04:30:22.792 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2024-01-13T04:30:22.793 DEBUG:teuthology.parallel:result is None 2024-01-13T04:30:22.978 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2024-01-13T04:30:22.979 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T04:30:23.003 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2024-01-13T04:30:23.003 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T04:30:23.028 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2024-01-13T04:30:23.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-01-13T04:30:23.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:30:23.101 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-01-13T04:30:23.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-01-13T04:30:23.171 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-01-13T04:30:23.229 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-01-13T04:30:23.229 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-01-13T04:30:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T04:30:23.288 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T04:30:23.289 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-01-13T04:30:23.311 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2024-01-13T04:30:23.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-13T04:30:23.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T04:30:23.386 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-01-13T04:30:23.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-01-13T04:30:23.458 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2024-01-13T04:30:23.516 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2024-01-13T04:30:23.516 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T04:30:23.573 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T04:30:23.574 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T04:30:23.574 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-01-13T04:30:23.574 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T04:30:23.574 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T04:30:23.574 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T04:30:23.574 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T04:30:23.574 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-01-13T04:30:23.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:30:23.681 INFO:teuthology.dispatcher.supervisor:Running job 7515181 2024-01-13T04:30:23.681 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515181 --name yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} -- /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515181/orig.config.yaml 2024-01-13T04:30:23.684 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515181 2024-01-13T04:30:23.685 INFO:teuthology.dispatcher.supervisor:Job PID: 2236589 2024-01-13T04:30:23.685 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T04:32:23.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:34:23.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:36:24.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:38:24.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:40:24.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:42:24.588 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:44:24.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T04:44:24.808 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T04:44:24.906 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T04:44:24.907 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T04:44:24.955 DEBUG:teuthology.nuke:shortname: smithi081 2024-01-13T04:44:24.955 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T04:44:24.978 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 04:25:20.012700', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO+ZiNmOqzPOKKWYU+99JXCOM8m/63nTbl3GQ57RhVq9voT3ORZj3567Od5kcKfztLSTsP9Wcvj/u2f+57h9TJM='} 2024-01-13T04:44:24.981 DEBUG:teuthology.nuke:shortname: smithi125 2024-01-13T04:44:24.981 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T04:44:25.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_15:24:25-rados-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7515181', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 04:25:20.010793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHWxTXxT0Essl4A2GqJ3GLkbW+nQq6Cewk+lHJ2YkPY2Wfh+BGns3I9bRgItlY61z17NTgn6pes++3k/nrzT6c='} 2024-01-13T04:44:25.037 INFO:teuthology.orchestra.console.smithi081:Power off 2024-01-13T04:44:25.037 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:44:25.058 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-01-13T04:44:25.058 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:44:25.073 INFO:teuthology.orchestra.console.smithi125:Power off 2024-01-13T04:44:25.073 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T04:44:25.082 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-01-13T04:44:25.097 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-01-13T04:44:25.097 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T04:44:25.119 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-01-13T04:44:25.183 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-01-13T04:44:25.219 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-01-13T04:44:25.347 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2024-01-13T04:44:25.364 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com