2024-01-13T08:01:05.229 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-13T08:01:05.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:01:05.370 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe5cd16ac10>, signals=[15]) 2024-01-13T08:01:05.371 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging 2024-01-13T08:01:05.371 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T08:01:05.371 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-01-13T08:01:05.391 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2024-01-13T08:01:05.391 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2024-01-13T08:01:05.391 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-01-13T08:01:05.506 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T08:01:05.517 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_rhel_8.6 (ID 5) 2024-01-13T08:01:05.549 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of rhel 8.6 2024-01-13T08:01:05.557 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.6 2024-01-13T08:01:05.853 INFO:teuthology.orchestra.console.smithi110:Power off 2024-01-13T08:01:05.853 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T08:01:05.868 INFO:teuthology.orchestra.console.smithi116:Power off 2024-01-13T08:01:05.869 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T08:01:05.876 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-01-13T08:01:05.877 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:05.891 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-01-13T08:01:05.891 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:05.900 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-13T08:01:05.913 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-13T08:01:09.904 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:09.915 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:10.013 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-13T08:01:10.028 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-13T08:01:14.018 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:14.029 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:14.127 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-13T08:01:14.137 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-13T08:01:14.229 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-01-13T08:01:14.238 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-01-13T08:01:14.330 INFO:teuthology.orchestra.console.smithi110:Power on 2024-01-13T08:01:14.330 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T08:01:14.340 INFO:teuthology.orchestra.console.smithi116:Power on 2024-01-13T08:01:14.340 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-13T08:01:14.351 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On 2024-01-13T08:01:14.352 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:14.363 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2024-01-13T08:01:14.363 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:14.372 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-13T08:01:14.383 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-13T08:01:18.376 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:18.387 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:18.489 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-13T08:01:18.496 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-13T08:01:22.492 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:22.499 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:01:22.608 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-01-13T08:01:22.679 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-13T08:01:22.709 INFO:teuthology.orchestra.console.smithi116:Power on completed 2024-01-13T08:01:22.780 INFO:teuthology.orchestra.console.smithi110:Power on completed 2024-01-13T08:01:22.811 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2024-01-13T08:01:22.881 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish 2024-01-13T08:04:08.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:08.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:11.964 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:04:11.965 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-13T08:04:17.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:17.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:21.020 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:04:21.020 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-13T08:04:27.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:27.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:30.076 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:04:30.076 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-13T08:04:36.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:36.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:39.164 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:04:39.164 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-13T08:04:45.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:45.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:48.220 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:04:48.220 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-13T08:04:54.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:54.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:04:57.276 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:04:57.276 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-01-13T08:05:03.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:05:03.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:05:21.596 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:05:27.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:05:30.652 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:05:36.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:05:39.740 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-01-13T08:05:45.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:05:46.264 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T08:05:46.264 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T08:06:01.789 INFO:teuthology.provision.fog.smithi110:Node is ready 2024-01-13T08:06:01.789 DEBUG:teuthology.orchestra.run.smithi110:> hostname 2024-01-13T08:06:01.811 INFO:teuthology.orchestra.run.smithi110.stdout:smithi045 2024-01-13T08:06:01.811 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi045 /etc/hosts 2024-01-13T08:06:01.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-13T08:06:01.872 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi045/smithi110/g' /etc/hostname 2024-01-13T08:06:02.009 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110 2024-01-13T08:06:02.038 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-01-13T08:06:02.096 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-13T08:06:02.097 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T08:06:02.098 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T08:06:02.098 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T08:06:02.098 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T08:06:02.098 INFO:teuthology.provision.fog.smithi110:Deploy complete! 2024-01-13T08:06:02.100 DEBUG:teuthology.parallel:result is None 2024-01-13T08:06:03.284 WARNING:teuthology.provision.fog.smithi116:timed out 2024-01-13T08:06:09.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:06:09.522 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-13T08:06:09.522 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-13T08:06:09.802 INFO:teuthology.provision.fog.smithi116:Node is ready 2024-01-13T08:06:09.803 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2024-01-13T08:06:09.820 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2024-01-13T08:06:09.820 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2024-01-13T08:06:09.878 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2024-01-13T08:06:09.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2024-01-13T08:06:09.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2024-01-13T08:06:10.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2024-01-13T08:06:10.087 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2024-01-13T08:06:10.155 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2024-01-13T08:06:10.222 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T08:06:10.279 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T08:06:10.280 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T08:06:10.281 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2024-01-13T08:06:10.281 DEBUG:teuthology.parallel:result is None 2024-01-13T08:06:10.462 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com 2024-01-13T08:06:10.462 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T08:06:10.482 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2024-01-13T08:06:10.482 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-13T08:06:10.499 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server 2024-01-13T08:06:10.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-13T08:06:10.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:06:10.579 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-01-13T08:06:10.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-13T08:06:10.652 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-01-13T08:06:10.710 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-01-13T08:06:10.710 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-01-13T08:06:10.768 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T08:06:10.768 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T08:06:10.768 INFO:teuthology.orchestra.run.smithi110.stdout:ID="rhel" 2024-01-13T08:06:10.768 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="fedora" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="8.6" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el8" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T08:06:10.769 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T08:06:10.770 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-01-13T08:06:10.886 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2024-01-13T08:06:10.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-13T08:06:10.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-13T08:06:10.956 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-01-13T08:06:11.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-01-13T08:06:11.026 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-01-13T08:06:11.083 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-01-13T08:06:11.083 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-01-13T08:06:11.140 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2024-01-13T08:06:11.140 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout: 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-01-13T08:06:11.141 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-01-13T08:06:11.142 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-01-13T08:06:11.142 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-01-13T08:06:11.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:06:11.252 INFO:teuthology.dispatcher.supervisor:Running job 7515730 2024-01-13T08:06:11.252 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-12_21:52:25-rados-wip-yuri2-testing-2024-01-12-1128-pacific-distro-default-smithi/7515730 --name yuriw-2024-01-12_21:52:25-rados-wip-yuri2-testing-2024-01-12-1128-pacific-distro-default-smithi --description rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.6_container_tools_3.0 fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/yuriw-2024-01-12_21:52:25-rados-wip-yuri2-testing-2024-01-12-1128-pacific-distro-default-smithi/7515730/orig.config.yaml 2024-01-13T08:06:11.256 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-12_21:52:25-rados-wip-yuri2-testing-2024-01-12-1128-pacific-distro-default-smithi/7515730 2024-01-13T08:06:11.256 INFO:teuthology.dispatcher.supervisor:Job PID: 3810359 2024-01-13T08:06:11.256 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-13T08:08:11.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:10:11.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:12:11.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:14:11.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:16:12.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:18:12.212 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:20:12.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-13T08:20:12.447 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-13T08:20:12.532 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-13T08:20:12.532 INFO:teuthology.nuke:Checking targets against current locks 2024-01-13T08:20:12.582 DEBUG:teuthology.nuke:shortname: smithi110 2024-01-13T08:20:12.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T08:20:12.609 DEBUG:teuthology.nuke:shortname: smithi116 2024-01-13T08:20:12.609 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-13T08:20:12.612 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_21:52:25-rados-wip-yuri2-testing-2024-01-12-1128-pacific-distro-default-smithi/7515730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 08:01:04.163203', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKL5VbmBwb0gEsFmYvAk/3gfuvkJ7VKVlbRTthOlt76WmRvmdpY7YA+mT7lrM94/Aww1+G+FIEtC4nGOcbn6NcY='} 2024-01-13T08:20:12.633 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-12_21:52:25-rados-wip-yuri2-testing-2024-01-12-1128-pacific-distro-default-smithi/7515730', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-13 08:01:04.164715', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIg7qnp2useb+2vww/hYOiFqfoBQOu79XKAJqGuJRGxfaNlk80sK8k+P12PqFdQnARcaYIvnI8c3EauUTtC8IEU='} 2024-01-13T08:20:12.669 INFO:teuthology.orchestra.console.smithi110:Power off 2024-01-13T08:20:12.669 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T08:20:12.693 INFO:teuthology.orchestra.console.smithi116:Power off 2024-01-13T08:20:12.695 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-13T08:20:12.705 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-01-13T08:20:12.705 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:20:12.716 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-01-13T08:20:12.717 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-13T08:20:12.725 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-13T08:20:12.740 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-01-13T08:20:12.826 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-01-13T08:20:12.841 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-01-13T08:20:12.978 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com 2024-01-13T08:20:12.988 INFO:teuthology.lock.ops:unlocked: smithi116.front.sepia.ceph.com