2023-12-26T17:23:01.376 INFO:root:teuthology version: 0.0.1.dev226+g9680d2a 2023-12-26T17:23:01.376 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:23:01.518 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0a74207940>, signals=[15]) 2023-12-26T17:23:01.519 INFO:teuthology.lock.ops:Start node 'smithi113.front.sepia.ceph.com' reimaging 2023-12-26T17:23:01.519 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T17:23:01.519 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-26T17:23:01.544 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging 2023-12-26T17:23:01.544 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server 2023-12-26T17:23:01.544 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-26T17:23:01.657 DEBUG:teuthology.provision.fog.smithi113:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-26T17:23:01.679 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-26T17:23:01.703 INFO:teuthology.provision.fog.smithi113:Scheduling deploy of rhel 8.4 2023-12-26T17:23:01.725 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of rhel 8.4 2023-12-26T17:23:01.985 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-26T17:23:01.986 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:23:02.003 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-26T17:23:02.004 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:23:02.015 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-26T17:23:02.015 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:02.028 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-26T17:23:02.028 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:02.037 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-26T17:23:02.052 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-26T17:23:02.138 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-26T17:23:02.156 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-26T17:23:02.239 INFO:teuthology.orchestra.console.smithi141:Power on 2023-12-26T17:23:02.239 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T17:23:02.258 INFO:teuthology.orchestra.console.smithi113:Power on 2023-12-26T17:23:02.258 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-26T17:23:02.269 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On 2023-12-26T17:23:02.270 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:02.283 DEBUG:teuthology.orchestra.console.smithi113:power on output: Chassis Power Control: Up/On 2023-12-26T17:23:02.283 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:02.299 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-26T17:23:02.313 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-26T17:23:06.301 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:06.316 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:06.411 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-26T17:23:06.434 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is on 2023-12-26T17:23:06.535 INFO:teuthology.orchestra.console.smithi113:Power on completed 2023-12-26T17:23:06.635 INFO:teuthology.provision.fog.smithi113:Waiting for deploy to finish 2023-12-26T17:23:10.414 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:23:10.526 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on 2023-12-26T17:23:10.626 INFO:teuthology.orchestra.console.smithi141:Power on completed 2023-12-26T17:23:10.727 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish 2023-12-26T17:25:56.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:25:59.890 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-26T17:26:05.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:07.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:08.949 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-26T17:26:10.961 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:26:14.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:16.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:18.037 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-26T17:26:20.021 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:26:24.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:26.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:27.121 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-26T17:26:29.105 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:26:33.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:35.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:36.181 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141 2023-12-26T17:26:38.165 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:26:42.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:44.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:47.249 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:26:53.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:26:56.337 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:27:02.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:27:05.393 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:27:11.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:27:14.485 WARNING:teuthology.provision.fog.smithi113:[Errno None] Unable to connect to port 22 on 172.21.15.113 2023-12-26T17:27:20.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:27:42.210 WARNING:teuthology.provision.fog.smithi141:timed out 2023-12-26T17:27:48.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:27:48.664 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T17:27:48.665 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T17:27:48.910 INFO:teuthology.provision.fog.smithi141:Node is ready 2023-12-26T17:27:48.910 DEBUG:teuthology.orchestra.run.smithi141:> hostname 2023-12-26T17:27:48.963 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141 2023-12-26T17:27:48.964 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141 /etc/hosts 2023-12-26T17:27:49.018 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141 2023-12-26T17:27:49.019 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-12-26T17:27:49.130 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141/smithi141/g' /etc/hosts 2023-12-26T17:27:49.154 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts 2023-12-26T17:27:49.217 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141/smithi141/g' /etc/hostname 2023-12-26T17:27:49.280 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141 2023-12-26T17:27:49.342 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.4" 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:27:49.397 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:27:49.398 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:27:49.399 INFO:teuthology.provision.fog.smithi141:Deploy complete! 2023-12-26T17:27:49.400 DEBUG:teuthology.parallel:result is None 2023-12-26T17:28:20.522 WARNING:teuthology.provision.fog.smithi113:timed out 2023-12-26T17:28:26.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:28:26.854 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-26T17:28:26.855 DEBUG:teuthology.orchestra.run.smithi113:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-26T17:28:27.124 INFO:teuthology.provision.fog.smithi113:Node is ready 2023-12-26T17:28:27.124 DEBUG:teuthology.orchestra.run.smithi113:> hostname 2023-12-26T17:28:27.140 INFO:teuthology.orchestra.run.smithi113.stdout:smithi113.front.sepia.ceph.com 2023-12-26T17:28:27.140 DEBUG:teuthology.orchestra.run.smithi113:> grep smithi113.front.sepia.ceph.com /etc/hosts 2023-12-26T17:28:27.197 INFO:teuthology.orchestra.run.smithi113.stdout:172.21.15.113 smithi113.front.sepia.ceph.com smithi113 2023-12-26T17:28:27.197 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-26T17:28:27.305 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hosts 2023-12-26T17:28:27.331 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/172.21.15.113/172.21.15.113/g' /etc/hosts 2023-12-26T17:28:27.397 DEBUG:teuthology.orchestra.run.smithi113:> sudo sed -i -e 's/smithi113.front.sepia.ceph.com/smithi113/g' /etc/hostname 2023-12-26T17:28:27.463 DEBUG:teuthology.orchestra.run.smithi113:> sudo hostname smithi113 2023-12-26T17:28:27.527 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-26T17:28:27.581 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:28:27.581 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:28:27.581 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel" 2023-12-26T17:28:27.581 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora" 2023-12-26T17:28:27.581 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.4" 2023-12-26T17:28:27.581 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:28:27.582 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:28:27.582 INFO:teuthology.provision.fog.smithi113:Deploy complete! 2023-12-26T17:28:27.583 DEBUG:teuthology.parallel:result is None 2023-12-26T17:28:27.760 INFO:teuthology.lock.ops:Checking smithi113.front.sepia.ceph.com 2023-12-26T17:28:27.761 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T17:28:27.788 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com 2023-12-26T17:28:27.788 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-26T17:28:27.814 INFO:teuthology.lock.ops:Updating [smithi113.front.sepia.ceph.com]: set os type and version on server 2023-12-26T17:28:27.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-26T17:28:27.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi113.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:28:27.881 DEBUG:teuthology.orchestra.run.smithi113:> true 2023-12-26T17:28:27.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi113.front.sepia.ceph.com' 2023-12-26T17:28:27.943 DEBUG:teuthology.orchestra.run.smithi113:> uname -m 2023-12-26T17:28:27.998 INFO:teuthology.orchestra.run.smithi113.stdout:x86_64 2023-12-26T17:28:27.998 DEBUG:teuthology.orchestra.run.smithi113:> cat /etc/os-release 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:ID="rhel" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:ID_LIKE="fedora" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:VERSION_ID="8.4" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:ANSI_COLOR="0;31" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:28:28.053 INFO:teuthology.orchestra.run.smithi113.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:28:28.054 INFO:teuthology.orchestra.run.smithi113.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:28:28.054 INFO:teuthology.orchestra.run.smithi113.stdout: 2023-12-26T17:28:28.054 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:28:28.054 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:28:28.054 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:28:28.054 INFO:teuthology.orchestra.run.smithi113.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:28:28.054 INFO:teuthology.lock.ops:Updating smithi113.front.sepia.ceph.com on lock server 2023-12-26T17:28:28.080 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server 2023-12-26T17:28:28.080 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-26T17:28:28.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-26T17:28:28.149 DEBUG:teuthology.orchestra.run.smithi141:> true 2023-12-26T17:28:28.268 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com' 2023-12-26T17:28:28.268 DEBUG:teuthology.orchestra.run.smithi141:> uname -m 2023-12-26T17:28:28.323 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64 2023-12-26T17:28:28.323 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release 2023-12-26T17:28:28.377 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="Red Hat Enterprise Linux" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="8.4 (Ootpa)" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:ID="rhel" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="fedora" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="8.4" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el8" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://www.redhat.com/" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout: 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-26T17:28:28.378 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-26T17:28:28.379 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-26T17:28:28.379 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-26T17:28:28.380 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server 2023-12-26T17:28:28.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:28:28.492 INFO:teuthology.dispatcher.supervisor:Running job 7501521 2023-12-26T17:28:28.492 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9680d2aba1e76f64ade295c81599c97907457848/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501521 --name yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} -- /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501521/orig.config.yaml 2023-12-26T17:28:28.496 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501521 2023-12-26T17:28:28.496 INFO:teuthology.dispatcher.supervisor:Job PID: 609697 2023-12-26T17:28:28.496 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-26T17:30:28.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:32:28.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:34:28.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:36:29.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:38:29.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-26T17:38:29.328 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-26T17:38:29.430 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-26T17:38:29.431 INFO:teuthology.nuke:Checking targets against current locks 2023-12-26T17:38:29.486 DEBUG:teuthology.nuke:shortname: smithi113 2023-12-26T17:38:29.486 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-26T17:38:29.509 DEBUG:teuthology.nuke:shortname: smithi141 2023-12-26T17:38:29.509 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-26T17:38:29.513 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi113.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 17:23:00.523809', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNLXP5qylZtTAmft+lBsriIgQ4e8nd9ixVFSW+dwwQl8vMizbU8cbvhkwmX6JafwQddfv1sg7HOxGzcsIGsqgB0='} 2023-12-26T17:38:29.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-26_16:41:10-rados-wip-yuri7-testing-2023-12-20-0808-pacific-distro-default-smithi/7501521', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-26 17:23:00.521958', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNGAlgZrdFww6Fnuz/4WfVXqWGtKuqZIKiKSSGfbrpxZiFA3KQ2inOSTWYolG4QrwJBpIFg74/bu6UuzsGPi1Wo='} 2023-12-26T17:38:29.570 INFO:teuthology.orchestra.console.smithi113:Power off 2023-12-26T17:38:29.570 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:38:29.597 DEBUG:teuthology.orchestra.console.smithi113:power off output: Chassis Power Control: Down/Off 2023-12-26T17:38:29.598 DEBUG:teuthology.orchestra.console.smithi113:pexpect command: ipmitool -H smithi113.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:38:29.612 INFO:teuthology.orchestra.console.smithi141:Power off 2023-12-26T17:38:29.613 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-26T17:38:29.620 DEBUG:teuthology.orchestra.console.smithi113:check power output: Chassis Power is off 2023-12-26T17:38:29.634 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off 2023-12-26T17:38:29.634 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-26T17:38:29.656 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off 2023-12-26T17:38:29.721 INFO:teuthology.orchestra.console.smithi113:Power off completed 2023-12-26T17:38:29.757 INFO:teuthology.orchestra.console.smithi141:Power off completed 2023-12-26T17:38:29.875 INFO:teuthology.lock.ops:unlocked: smithi113.front.sepia.ceph.com 2023-12-26T17:38:29.900 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com