2023-12-14T03:15:52.486 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-14T03:15:52.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:15:52.633 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd03af51940>, signals=[15]) 2023-12-14T03:15:52.634 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-12-14T03:15:52.634 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T03:15:52.634 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-14T03:15:52.654 INFO:teuthology.lock.ops:Start node 'smithi140.front.sepia.ceph.com' reimaging 2023-12-14T03:15:52.654 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: reset os type and version on server 2023-12-14T03:15:52.654 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-12-14T03:15:52.779 DEBUG:teuthology.provision.fog.smithi037:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T03:15:52.791 DEBUG:teuthology.provision.fog.smithi140:Requesting image smithi_rhel_8.4 (ID 7) 2023-12-14T03:15:52.827 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.4 2023-12-14T03:15:52.840 INFO:teuthology.provision.fog.smithi140:Scheduling deploy of rhel 8.4 2023-12-14T03:15:53.137 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-14T03:15:53.138 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T03:15:53.150 INFO:teuthology.orchestra.console.smithi140:Power off 2023-12-14T03:15:53.151 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T03:15:53.160 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-14T03:15:53.160 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:15:53.170 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-12-14T03:15:53.170 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:15:53.181 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T03:15:53.189 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-14T03:15:53.282 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-14T03:15:53.290 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-12-14T03:15:53.383 INFO:teuthology.orchestra.console.smithi037:Power on 2023-12-14T03:15:53.383 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T03:15:53.392 INFO:teuthology.orchestra.console.smithi140:Power on 2023-12-14T03:15:53.392 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-14T03:15:53.406 DEBUG:teuthology.orchestra.console.smithi037:power on output: Chassis Power Control: Up/On 2023-12-14T03:15:53.406 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:15:53.415 DEBUG:teuthology.orchestra.console.smithi140:power on output: Chassis Power Control: Up/On 2023-12-14T03:15:53.415 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:15:53.429 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T03:15:53.436 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-14T03:15:57.435 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:15:57.441 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:15:57.544 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2023-12-14T03:15:57.550 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-14T03:15:57.645 INFO:teuthology.orchestra.console.smithi037:Power on completed 2023-12-14T03:15:57.746 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-12-14T03:16:01.553 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:16:01.663 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is on 2023-12-14T03:16:01.764 INFO:teuthology.orchestra.console.smithi140:Power on completed 2023-12-14T03:16:01.865 INFO:teuthology.provision.fog.smithi140:Waiting for deploy to finish 2023-12-14T03:18:28.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:18:32.049 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:18:38.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:18:41.109 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:18:47.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:18:48.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:18:48.474 ERROR:teuthology.orchestra.connection:Error authenticating with smithi140.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-14T03:18:50.197 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:18:56.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:18:59.249 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:19:05.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:19:08.305 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:19:14.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:19:32.625 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:19:38.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:19:41.685 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:19:47.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:19:50.738 WARNING:teuthology.provision.fog.smithi037:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-14T03:19:52.477 WARNING:teuthology.provision.fog.smithi140:timed out 2023-12-14T03:19:56.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:19:57.058 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T03:19:57.058 DEBUG:teuthology.orchestra.run.smithi037:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T03:19:58.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:20:12.334 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-12-14T03:20:12.335 DEBUG:teuthology.orchestra.run.smithi037:> hostname 2023-12-14T03:20:12.353 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-12-14T03:20:12.353 DEBUG:teuthology.orchestra.run.smithi037:> grep smithi037.front.sepia.ceph.com /etc/hosts 2023-12-14T03:20:12.408 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-12-14T03:20:12.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-12-14T03:20:12.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hosts 2023-12-14T03:20:12.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/172.21.15.37/172.21.15.37/g' /etc/hosts 2023-12-14T03:20:12.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i -e 's/smithi037.front.sepia.ceph.com/smithi037/g' /etc/hostname 2023-12-14T03:20:12.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname smithi037 2023-12-14T03:20:12.771 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-14T03:20:12.825 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T03:20:12.825 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T03:20:12.825 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T03:20:12.826 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T03:20:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T03:20:12.827 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-12-14T03:20:12.829 DEBUG:teuthology.parallel:result is None 2023-12-14T03:20:58.481 WARNING:teuthology.provision.fog.smithi140:timed out 2023-12-14T03:21:04.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:21:04.903 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-14T03:21:04.904 DEBUG:teuthology.orchestra.run.smithi140:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-14T03:21:05.212 INFO:teuthology.provision.fog.smithi140:Node is ready 2023-12-14T03:21:05.212 DEBUG:teuthology.orchestra.run.smithi140:> hostname 2023-12-14T03:21:05.266 INFO:teuthology.orchestra.run.smithi140.stdout:smithi140.front.sepia.ceph.com 2023-12-14T03:21:05.267 DEBUG:teuthology.orchestra.run.smithi140:> grep smithi140.front.sepia.ceph.com /etc/hosts 2023-12-14T03:21:05.321 INFO:teuthology.orchestra.run.smithi140.stdout:172.21.15.140 smithi140.front.sepia.ceph.com smithi140 2023-12-14T03:21:05.321 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-12-14T03:21:05.453 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hosts 2023-12-14T03:21:05.478 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/172.21.15.140/172.21.15.140/g' /etc/hosts 2023-12-14T03:21:05.541 DEBUG:teuthology.orchestra.run.smithi140:> sudo sed -i -e 's/smithi140.front.sepia.ceph.com/smithi140/g' /etc/hostname 2023-12-14T03:21:05.607 DEBUG:teuthology.orchestra.run.smithi140:> sudo hostname smithi140 2023-12-14T03:21:05.669 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-12-14T03:21:05.723 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T03:21:05.723 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T03:21:05.723 INFO:teuthology.orchestra.run.smithi140.stdout:ID="rhel" 2023-12-14T03:21:05.723 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="fedora" 2023-12-14T03:21:05.723 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8.4" 2023-12-14T03:21:05.723 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout: 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T03:21:05.724 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T03:21:05.725 INFO:teuthology.provision.fog.smithi140:Deploy complete! 2023-12-14T03:21:05.725 DEBUG:teuthology.parallel:result is None 2023-12-14T03:21:05.869 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-12-14T03:21:05.869 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T03:21:05.890 INFO:teuthology.lock.ops:Checking smithi140.front.sepia.ceph.com 2023-12-14T03:21:05.890 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-14T03:21:05.907 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-12-14T03:21:05.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-14T03:21:05.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:21:05.978 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-14T03:21:06.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-14T03:21:06.058 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-12-14T03:21:06.113 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-12-14T03:21:06.114 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-14T03:21:06.169 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T03:21:06.170 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T03:21:06.171 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T03:21:06.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-14T03:21:06.171 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T03:21:06.171 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T03:21:06.171 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T03:21:06.171 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T03:21:06.172 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-14T03:21:06.190 INFO:teuthology.lock.ops:Updating [smithi140.front.sepia.ceph.com]: set os type and version on server 2023-12-14T03:21:06.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-12-14T03:21:06.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi140.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-14T03:21:06.261 DEBUG:teuthology.orchestra.run.smithi140:> true 2023-12-14T03:21:06.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi140.front.sepia.ceph.com' 2023-12-14T03:21:06.322 DEBUG:teuthology.orchestra.run.smithi140:> uname -m 2023-12-14T03:21:06.380 INFO:teuthology.orchestra.run.smithi140.stdout:x86_64 2023-12-14T03:21:06.380 DEBUG:teuthology.orchestra.run.smithi140:> cat /etc/os-release 2023-12-14T03:21:06.438 INFO:teuthology.orchestra.run.smithi140.stdout:NAME="Red Hat Enterprise Linux" 2023-12-14T03:21:06.438 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION="8.4 (Ootpa)" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:ID="rhel" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:ID_LIKE="fedora" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:VERSION_ID="8.4" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:PLATFORM_ID="platform:el8" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:ANSI_COLOR="0;31" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:HOME_URL="https://www.redhat.com/" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-14T03:21:06.439 INFO:teuthology.orchestra.run.smithi140.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-14T03:21:06.440 INFO:teuthology.orchestra.run.smithi140.stdout: 2023-12-14T03:21:06.440 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-14T03:21:06.440 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-12-14T03:21:06.440 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-14T03:21:06.440 INFO:teuthology.orchestra.run.smithi140.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-12-14T03:21:06.440 INFO:teuthology.lock.ops:Updating smithi140.front.sepia.ceph.com on lock server 2023-12-14T03:21:06.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:21:06.549 INFO:teuthology.dispatcher.supervisor:Running job 7491075 2023-12-14T03:21:06.549 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_00:45:17-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491075 --name yuriw-2023-12-14_00:45:17-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-bootstrap-workunit} -- /home/teuthworker/archive/yuriw-2023-12-14_00:45:17-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491075/orig.config.yaml 2023-12-14T03:21:06.553 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_00:45:17-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491075 2023-12-14T03:21:06.553 INFO:teuthology.dispatcher.supervisor:Job PID: 1916590 2023-12-14T03:21:06.553 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-14T03:23:06.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:25:06.629 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:27:06.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:29:06.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:31:06.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-14T03:31:06.911 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-14T03:31:07.018 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-14T03:31:07.019 INFO:teuthology.nuke:Checking targets against current locks 2023-12-14T03:31:07.064 DEBUG:teuthology.nuke:shortname: smithi037 2023-12-14T03:31:07.065 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T03:31:07.086 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_00:45:17-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 03:15:51.668790', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKYzkL+X/eyA0IbzEwDL5uwbnSr9q1JJ/Ob4ROnEmJbSjZHWuaW1dJh3ckHz7b97SzkpTSBX+Ms9HJN7MD6I9BE='} 2023-12-14T03:31:07.091 DEBUG:teuthology.nuke:shortname: smithi140 2023-12-14T03:31:07.091 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-14T03:31:07.113 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi140.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_00:45:17-rbd-wip-yuri4-testing-2023-12-13-0748-quincy-distro-default-smithi/7491075', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 03:15:51.667044', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD+kOPl9ZBHIhotUAWmyFam4oG/+awF2HcQdUSYIDNjS6CErx/vekmLL30aS1aEhSTKAxGoKiqg38Zb4KQKa6u8='} 2023-12-14T03:31:07.133 INFO:teuthology.orchestra.console.smithi037:Power off 2023-12-14T03:31:07.133 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T03:31:07.157 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2023-12-14T03:31:07.158 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:31:07.175 INFO:teuthology.orchestra.console.smithi140:Power off 2023-12-14T03:31:07.176 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-14T03:31:07.185 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2023-12-14T03:31:07.199 DEBUG:teuthology.orchestra.console.smithi140:power off output: Chassis Power Control: Down/Off 2023-12-14T03:31:07.199 DEBUG:teuthology.orchestra.console.smithi140:pexpect command: ipmitool -H smithi140.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-14T03:31:07.224 DEBUG:teuthology.orchestra.console.smithi140:check power output: Chassis Power is off 2023-12-14T03:31:07.286 INFO:teuthology.orchestra.console.smithi037:Power off completed 2023-12-14T03:31:07.325 INFO:teuthology.orchestra.console.smithi140:Power off completed 2023-12-14T03:31:07.442 INFO:teuthology.lock.ops:unlocked: smithi037.front.sepia.ceph.com 2023-12-14T03:31:07.474 INFO:teuthology.lock.ops:unlocked: smithi140.front.sepia.ceph.com