2023-12-11T15:12:53.741 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-11T15:12:53.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:12:53.907 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5dd4dcf940>, signals=[15]) 2023-12-11T15:12:53.907 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2023-12-11T15:12:53.907 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T15:12:53.908 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-11T15:12:53.930 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2023-12-11T15:12:53.930 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2023-12-11T15:12:53.931 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-11T15:12:54.048 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T15:12:54.059 DEBUG:teuthology.provision.fog.smithi190:Requesting image smithi_rhel_8.6 (ID 5) 2023-12-11T15:12:54.091 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6 2023-12-11T15:12:54.108 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of rhel 8.6 2023-12-11T15:12:54.416 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-11T15:12:54.416 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T15:12:54.443 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-11T15:12:54.444 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T15:12:54.456 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-11T15:12:54.457 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:12:54.475 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-11T15:12:54.476 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:12:54.496 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-11T15:12:54.512 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T15:12:58.498 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:12:58.513 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:12:58.613 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-11T15:12:58.626 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T15:13:02.618 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:02.627 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:02.728 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-11T15:13:02.735 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T15:13:06.734 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:06.742 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:06.844 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-11T15:13:06.854 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T15:13:06.946 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-11T15:13:06.956 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-11T15:13:07.047 INFO:teuthology.orchestra.console.smithi190:Power on 2023-12-11T15:13:07.048 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T15:13:07.057 INFO:teuthology.orchestra.console.smithi138:Power on 2023-12-11T15:13:07.058 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-11T15:13:07.073 DEBUG:teuthology.orchestra.console.smithi190:power on output: Chassis Power Control: Up/On 2023-12-11T15:13:07.073 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:07.086 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2023-12-11T15:13:07.087 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:07.104 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-11T15:13:07.113 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T15:13:11.109 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:11.120 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:11.222 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-11T15:13:11.239 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-11T15:13:11.340 INFO:teuthology.orchestra.console.smithi138:Power on completed 2023-12-11T15:13:11.441 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2023-12-11T15:13:15.228 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:13:15.348 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-12-11T15:13:15.449 INFO:teuthology.orchestra.console.smithi190:Power on completed 2023-12-11T15:13:15.554 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2023-12-11T15:13:15.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:13:18.758 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:13:24.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:13:27.846 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:13:33.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:13:36.930 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:13:42.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:13:45.986 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:13:51.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:13:55.042 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:14:01.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:14:04.098 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:14:10.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:14:13.186 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:14:19.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:14:22.246 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:14:28.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:14:46.758 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:14:52.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:14:54.958 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:15:00.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:15:01.090 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:15:05.217 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:15:12.343 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:15:22.469 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:15:35.598 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:15:51.688 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:15:58.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:01.346 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:16:07.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:10.402 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:16:10.815 ERROR:teuthology.orchestra.connection:Error authenticating with smithi190.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-12-11T15:16:16.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:19.458 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:16:25.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:28.518 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:16:34.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:37.574 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:16:43.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:46.626 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:16:51.174 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:16:52.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:57.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:16:59.970 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:17:05.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:17:09.026 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:17:11.145 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:17:15.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:17:15.174 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:17:17.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:17:20.226 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-11T15:17:21.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:17:24.226 WARNING:teuthology.provision.fog.smithi190:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-12-11T15:17:26.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:17:27.463 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T15:17:27.464 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T15:17:27.774 INFO:teuthology.provision.fog.smithi138:Node is ready 2023-12-11T15:17:27.774 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2023-12-11T15:17:27.790 INFO:teuthology.orchestra.run.smithi138.stdout:smithi022 2023-12-11T15:17:27.791 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi022 /etc/hosts 2023-12-11T15:17:27.847 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-12-11T15:17:27.848 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-12-11T15:17:27.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi022/smithi138/g' /etc/hosts 2023-12-11T15:17:28.000 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.22/172.21.15.138/g' /etc/hosts 2023-12-11T15:17:28.067 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi022/smithi138/g' /etc/hostname 2023-12-11T15:17:28.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2023-12-11T15:17:28.200 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-11T15:17:28.256 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T15:17:28.256 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T15:17:28.256 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T15:17:28.257 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T15:17:28.258 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T15:17:28.258 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-11T15:17:28.258 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T15:17:28.258 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T15:17:28.258 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T15:17:28.258 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T15:17:28.259 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2023-12-11T15:17:28.260 DEBUG:teuthology.parallel:result is None 2023-12-11T15:17:30.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:18:30.231 WARNING:teuthology.provision.fog.smithi190:timed out 2023-12-11T15:18:36.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:18:36.472 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-11T15:18:36.472 DEBUG:teuthology.orchestra.run.smithi190:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-11T15:18:36.774 INFO:teuthology.provision.fog.smithi190:Node is ready 2023-12-11T15:18:36.774 DEBUG:teuthology.orchestra.run.smithi190:> hostname 2023-12-11T15:18:36.792 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190 2023-12-11T15:18:36.793 DEBUG:teuthology.orchestra.run.smithi190:> grep smithi190 /etc/hosts 2023-12-11T15:18:36.851 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2023-12-11T15:18:36.851 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-12-11T15:18:36.968 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hosts 2023-12-11T15:18:36.998 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/172.21.15.190/172.21.15.190/g' /etc/hosts 2023-12-11T15:18:37.065 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i -e 's/smithi190/smithi190/g' /etc/hostname 2023-12-11T15:18:37.133 DEBUG:teuthology.orchestra.run.smithi190:> sudo hostname smithi190 2023-12-11T15:18:37.199 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-11T15:18:37.257 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T15:18:37.257 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T15:18:37.257 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-12-11T15:18:37.257 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-12-11T15:18:37.257 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-12-11T15:18:37.257 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-11T15:18:37.258 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T15:18:37.258 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-11T15:18:37.258 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T15:18:37.258 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T15:18:37.258 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T15:18:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T15:18:37.259 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-11T15:18:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T15:18:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T15:18:37.259 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T15:18:37.260 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T15:18:37.260 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2023-12-11T15:18:37.261 DEBUG:teuthology.parallel:result is None 2023-12-11T15:18:37.441 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2023-12-11T15:18:37.441 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-11T15:18:37.462 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2023-12-11T15:18:37.464 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2023-12-11T15:18:37.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-11T15:18:37.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:18:37.531 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-12-11T15:18:37.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-11T15:18:37.664 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-12-11T15:18:37.720 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-12-11T15:18:37.721 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-11T15:18:37.777 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T15:18:37.777 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T15:18:37.777 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T15:18:37.778 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T15:18:37.779 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T15:18:37.779 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T15:18:37.779 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-11T15:18:37.833 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2023-12-11T15:18:37.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-11T15:18:37.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T15:18:37.898 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-11T15:18:37.967 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-11T15:18:37.967 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-12-11T15:18:38.023 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-12-11T15:18:38.023 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-11T15:18:38.080 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-11T15:18:38.081 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-11T15:18:38.082 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-11T15:18:38.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:18:38.205 INFO:teuthology.dispatcher.supervisor:Running job 7486967 2023-12-11T15:18:38.205 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486967 --name adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi --description orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} -- /home/teuthworker/archive/adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486967/orig.config.yaml 2023-12-11T15:18:38.208 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486967 2023-12-11T15:18:38.209 INFO:teuthology.dispatcher.supervisor:Job PID: 1535248 2023-12-11T15:18:38.209 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-11T15:20:38.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:22:38.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:24:38.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:26:38.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:28:38.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:30:38.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T15:30:38.690 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-11T15:30:38.779 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486968 2023-12-11T15:30:38.779 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-11T15:30:38.780 INFO:teuthology.nuke:Checking targets against current locks 2023-12-11T15:30:38.826 DEBUG:teuthology.nuke:shortname: smithi138 2023-12-11T15:30:38.826 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T15:30:38.838 DEBUG:teuthology.nuke:shortname: smithi190 2023-12-11T15:30:38.838 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T15:30:38.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486967', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 15:12:52.823587', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T15:30:38.861 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-12-11_15:11:37-orch:cephadm-wip-adk-testing-2023-12-10-1329-distro-default-smithi/7486968', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 15:12:53.248359', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-11T15:30:38.904 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-11T15:30:38.904 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T15:30:38.919 INFO:teuthology.orchestra.console.smithi190:Power off 2023-12-11T15:30:38.919 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-11T15:30:38.928 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-11T15:30:38.929 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:30:38.941 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-12-11T15:30:38.941 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-11T15:30:38.952 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-11T15:30:38.962 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-12-11T15:30:39.053 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-11T15:30:39.063 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-12-11T15:30:39.205 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2023-12-11T15:30:39.212 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com