2023-12-20T22:38:33.128 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-20T22:38:33.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:38:33.264 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1eeebc7940>, signals=[15]) 2023-12-20T22:38:33.264 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-12-20T22:38:33.264 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-12-20T22:38:33.264 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-20T22:38:33.283 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-12-20T22:38:33.283 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-12-20T22:38:33.283 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-20T22:38:33.386 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-20T22:38:33.418 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-20T22:38:33.428 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.4 2023-12-20T22:38:33.478 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of rhel 8.4 2023-12-20T22:38:33.678 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-20T22:38:33.679 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T22:38:33.694 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-20T22:38:33.694 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T22:38:33.703 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-20T22:38:33.703 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:38:33.715 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-20T22:38:33.715 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:38:33.726 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-20T22:38:33.736 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-20T22:38:33.827 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-20T22:38:33.837 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-20T22:38:33.928 INFO:teuthology.orchestra.console.smithi027:Power on 2023-12-20T22:38:33.928 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-20T22:38:33.939 INFO:teuthology.orchestra.console.smithi069:Power on 2023-12-20T22:38:33.939 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-20T22:38:33.949 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-12-20T22:38:33.949 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:38:33.961 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-12-20T22:38:33.961 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:38:33.978 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-20T22:38:33.985 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-20T22:38:37.982 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:38:37.989 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:38:38.092 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-12-20T22:38:38.097 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-12-20T22:38:38.193 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-12-20T22:38:38.198 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-12-20T22:38:38.294 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-12-20T22:38:38.300 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-12-20T22:41:24.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:41:27.313 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-20T22:41:33.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:41:36.374 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-20T22:41:42.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:41:45.457 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-20T22:41:51.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:41:54.517 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-20T22:42:00.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:42:03.601 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-20T22:42:09.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:42:09.535 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-20T22:42:09.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:42:12.661 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-12-20T22:42:18.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:13.539 WARNING:teuthology.provision.fog.smithi027:timed out 2023-12-20T22:43:18.666 WARNING:teuthology.provision.fog.smithi069:timed out 2023-12-20T22:43:19.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:22.609 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-20T22:43:24.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:24.938 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-20T22:43:24.938 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-20T22:43:25.206 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-12-20T22:43:25.206 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-12-20T22:43:25.221 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-12-20T22:43:25.221 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-12-20T22:43:25.276 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-12-20T22:43:25.276 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-12-20T22:43:25.410 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-12-20T22:43:25.435 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-12-20T22:43:25.499 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-12-20T22:43:25.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-12-20T22:43:25.627 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-20T22:43:25.680 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T22:43:25.680 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.4 (Ootpa)" 2023-12-20T22:43:25.680 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-12-20T22:43:25.680 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.4" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T22:43:25.681 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-20T22:43:25.682 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-12-20T22:43:25.683 DEBUG:teuthology.parallel:result is None 2023-12-20T22:43:28.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:31.665 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-20T22:43:37.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:40.725 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-20T22:43:46.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:49.781 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-20T22:43:55.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:43:58.868 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-12-20T22:44:04.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:45:04.873 WARNING:teuthology.provision.fog.smithi027:timed out 2023-12-20T22:45:10.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:45:11.121 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-20T22:45:11.121 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-20T22:45:11.389 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-12-20T22:45:11.389 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-12-20T22:45:11.406 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-12-20T22:45:11.406 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-12-20T22:45:11.462 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-12-20T22:45:11.462 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-20T22:45:11.575 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-12-20T22:45:11.601 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-12-20T22:45:11.667 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-12-20T22:45:11.733 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-12-20T22:45:11.797 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-20T22:45:11.851 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T22:45:11.851 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.4 (Ootpa)" 2023-12-20T22:45:11.851 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.4" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T22:45:11.852 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-20T22:45:11.853 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-12-20T22:45:11.853 DEBUG:teuthology.parallel:result is None 2023-12-20T22:45:11.999 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-12-20T22:45:11.999 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-20T22:45:12.023 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-12-20T22:45:12.023 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-20T22:45:12.040 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-12-20T22:45:12.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-20T22:45:12.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:45:12.108 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-12-20T22:45:12.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-12-20T22:45:12.172 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-12-20T22:45:12.225 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-12-20T22:45:12.225 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-12-20T22:45:12.279 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T22:45:12.279 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.4 (Ootpa)" 2023-12-20T22:45:12.279 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2023-12-20T22:45:12.279 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.4" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T22:45:12.280 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-20T22:45:12.281 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-12-20T22:45:12.298 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-12-20T22:45:12.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-20T22:45:12.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T22:45:12.366 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-12-20T22:45:12.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-12-20T22:45:12.484 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-12-20T22:45:12.539 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-12-20T22:45:12.539 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-12-20T22:45:12.594 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-12-20T22:45:12.594 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.4 (Ootpa)" 2023-12-20T22:45:12.594 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-12-20T22:45:12.594 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-12-20T22:45:12.594 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.4" 2023-12-20T22:45:12.594 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-20T22:45:12.595 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-20T22:45:12.596 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-12-20T22:45:12.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:45:12.698 INFO:teuthology.dispatcher.supervisor:Running job 7498663 2023-12-20T22:45:12.698 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-20_19:57:16-rbd-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7498663 --name yuriw-2023-12-20_19:57:16-rbd-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi --description rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{rhel_8} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests} -- /home/teuthworker/archive/yuriw-2023-12-20_19:57:16-rbd-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7498663/orig.config.yaml 2023-12-20T22:45:12.702 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-20_19:57:16-rbd-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7498663 2023-12-20T22:45:12.702 INFO:teuthology.dispatcher.supervisor:Job PID: 2109386 2023-12-20T22:45:12.702 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-20T22:47:12.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:49:12.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:51:12.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:53:12.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:55:12.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T22:55:13.053 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-20T22:55:13.137 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-20T22:55:13.138 INFO:teuthology.nuke:Checking targets against current locks 2023-12-20T22:55:13.183 DEBUG:teuthology.nuke:shortname: smithi027 2023-12-20T22:55:13.184 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T22:55:13.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_19:57:16-rbd-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7498663', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 22:38:32.233434', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMM9voYTdznisJrU8imRXdaGumuiB3b4gKmv7h7st3+YEo5Gcy9PQr6txGbpI0rF3JNjPiAczl6k5pzcc8/xIbY='} 2023-12-20T22:55:13.214 DEBUG:teuthology.nuke:shortname: smithi069 2023-12-20T22:55:13.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T22:55:13.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-20_19:57:16-rbd-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7498663', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 22:38:32.234575', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAfmiwz+CjM+Fz/2g8Jlx4F2nDVSXGx0GeI0fgo4v2c5e8871e41ArI378MphyMqVMfP/luDQzFfBW6B5KSPORo='} 2023-12-20T22:55:13.250 INFO:teuthology.orchestra.console.smithi027:Power off 2023-12-20T22:55:13.251 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T22:55:13.273 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-12-20T22:55:13.273 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:55:13.286 INFO:teuthology.orchestra.console.smithi069:Power off 2023-12-20T22:55:13.286 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T22:55:13.295 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-12-20T22:55:13.307 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-12-20T22:55:13.307 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T22:55:13.328 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-12-20T22:55:13.396 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-12-20T22:55:13.429 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-12-20T22:55:13.542 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com 2023-12-20T22:55:13.576 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com