2023-11-29T21:24:09.744 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-11-29T21:24:09.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T21:24:09.884 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc829f4cdc0>, signals=[15]) 2023-11-29T21:24:09.885 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-11-29T21:24:09.886 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T21:24:09.886 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-29T21:24:09.907 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-11-29T21:24:09.907 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-11-29T21:24:09.907 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-29T21:24:10.033 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-29T21:24:10.043 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-29T21:24:10.076 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of rhel 8.6 2023-11-29T21:24:10.091 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of rhel 8.6 2023-11-29T21:24:10.347 INFO:teuthology.orchestra.console.smithi152:Power off 2023-11-29T21:24:10.348 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T21:24:10.359 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-29T21:24:10.360 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T21:24:10.368 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-11-29T21:24:10.368 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:10.382 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-29T21:24:10.382 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:10.389 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-29T21:24:10.406 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-29T21:24:14.394 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:14.408 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:14.502 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-29T21:24:14.515 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-29T21:24:18.506 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:18.516 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:18.617 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-29T21:24:18.624 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-29T21:24:18.718 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-11-29T21:24:18.725 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-29T21:24:18.819 INFO:teuthology.orchestra.console.smithi152:Power on 2023-11-29T21:24:18.819 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T21:24:18.827 INFO:teuthology.orchestra.console.smithi161:Power on 2023-11-29T21:24:18.828 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-29T21:24:18.842 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-11-29T21:24:18.842 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:18.852 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-11-29T21:24:18.853 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:18.872 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-29T21:24:18.874 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-29T21:24:22.874 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:22.881 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:22.983 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-29T21:24:22.990 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-29T21:24:26.986 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:26.992 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:24:27.095 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-11-29T21:24:27.102 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-29T21:24:27.196 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-11-29T21:24:27.203 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-11-29T21:24:27.297 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-11-29T21:24:27.304 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-11-29T21:27:13.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:13.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:16.450 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:27:16.454 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:27:22.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:22.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:25.506 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:27:25.506 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:27:31.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:31.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:34.562 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:27:34.563 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:27:40.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:40.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:43.618 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:27:43.618 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:27:49.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:49.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:52.674 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:27:52.710 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:27:58.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:27:58.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:28:01.762 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:28:01.766 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:28:07.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:28:07.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:28:10.854 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-29T21:28:10.855 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-11-29T21:28:16.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:28:16.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:29:16.919 WARNING:teuthology.provision.fog.smithi161:timed out 2023-11-29T21:29:16.919 WARNING:teuthology.provision.fog.smithi152:timed out 2023-11-29T21:29:22.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:29:22.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:29:23.261 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T21:29:23.261 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T21:29:23.265 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-29T21:29:23.265 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-29T21:29:23.549 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-11-29T21:29:23.549 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-11-29T21:29:23.567 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-11-29T21:29:23.568 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-11-29T21:29:23.571 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-11-29T21:29:23.572 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-11-29T21:29:23.589 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-11-29T21:29:23.590 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-11-29T21:29:23.626 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-11-29T21:29:23.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-11-29T21:29:23.647 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-11-29T21:29:23.648 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-11-29T21:29:23.753 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-11-29T21:29:23.766 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-11-29T21:29:23.782 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-11-29T21:29:23.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-11-29T21:29:23.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-11-29T21:29:23.864 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-11-29T21:29:23.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-11-29T21:29:23.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-11-29T21:29:23.985 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-29T21:29:23.999 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-11-29T21:29:24.043 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-11-29T21:29:24.043 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-11-29T21:29:24.043 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-11-29T21:29:24.043 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-29T21:29:24.044 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-29T21:29:24.045 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-29T21:29:24.045 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-11-29T21:29:24.047 DEBUG:teuthology.parallel:result is None 2023-11-29T21:29:24.056 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-11-29T21:29:24.057 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-29T21:29:24.058 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T21:29:24.058 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-29T21:29:24.058 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-29T21:29:24.058 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-29T21:29:24.058 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-29T21:29:24.058 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-29T21:29:24.058 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-11-29T21:29:24.059 DEBUG:teuthology.parallel:result is None 2023-11-29T21:29:24.208 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-11-29T21:29:24.208 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T21:29:24.229 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-11-29T21:29:24.229 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-29T21:29:24.246 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-11-29T21:29:24.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-29T21:29:24.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:29:24.313 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-11-29T21:29:24.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-11-29T21:29:24.379 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-11-29T21:29:24.436 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-11-29T21:29:24.437 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-11-29T21:29:24.493 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Red Hat Enterprise Linux" 2023-11-29T21:29:24.493 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8.6 (Ootpa)" 2023-11-29T21:29:24.493 INFO:teuthology.orchestra.run.smithi152.stdout:ID="rhel" 2023-11-29T21:29:24.493 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="fedora" 2023-11-29T21:29:24.493 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8.6" 2023-11-29T21:29:24.493 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.redhat.com/" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout: 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-29T21:29:24.494 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-29T21:29:24.495 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-11-29T21:29:24.515 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-11-29T21:29:24.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-29T21:29:24.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-29T21:29:24.581 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-11-29T21:29:24.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-29T21:29:24.652 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-11-29T21:29:24.710 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-11-29T21:29:24.710 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-11-29T21:29:24.767 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Red Hat Enterprise Linux" 2023-11-29T21:29:24.767 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8.6 (Ootpa)" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:ID="rhel" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="fedora" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8.6" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.redhat.com/" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-29T21:29:24.768 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-29T21:29:24.769 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-29T21:29:24.769 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-29T21:29:24.769 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-29T21:29:24.769 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-29T21:29:24.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T21:29:24.870 INFO:teuthology.dispatcher.supervisor:Running job 7471210 2023-11-29T21:29:24.870 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner zmc --archive /home/teuthworker/archive/zack-2023-11-29_21:23:36-orch:cephadm:smoke-main-distro-default-smithi/7471210 --name zack-2023-11-29_21:23:36-orch:cephadm:smoke-main-distro-default-smithi --description orch:cephadm:smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/zack-2023-11-29_21:23:36-orch:cephadm:smoke-main-distro-default-smithi/7471210/orig.config.yaml 2023-11-29T21:29:24.874 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/zack-2023-11-29_21:23:36-orch:cephadm:smoke-main-distro-default-smithi/7471210 2023-11-29T21:29:24.874 INFO:teuthology.dispatcher.supervisor:Job PID: 4004295 2023-11-29T21:29:24.874 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-29T21:31:24.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T21:33:25.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T21:35:25.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T21:37:25.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T21:37:25.546 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-29T21:37:25.632 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-29T21:37:25.632 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T21:37:25.684 DEBUG:teuthology.nuke:shortname: smithi152 2023-11-29T21:37:25.685 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T21:37:25.709 DEBUG:teuthology.nuke:shortname: smithi161 2023-11-29T21:37:25.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T21:37:25.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-11-29_21:23:36-orch:cephadm:smoke-main-distro-default-smithi/7471210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 21:24:08.936591', 'locked_by': 'zmc', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-29T21:37:25.738 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/zack-2023-11-29_21:23:36-orch:cephadm:smoke-main-distro-default-smithi/7471210', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 21:24:08.938036', 'locked_by': 'zmc', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-29T21:37:25.767 INFO:teuthology.orchestra.console.smithi152:Power off 2023-11-29T21:37:25.767 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T21:37:25.787 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-11-29T21:37:25.788 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:37:25.799 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-29T21:37:25.799 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T21:37:25.807 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-11-29T21:37:25.818 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-29T21:37:25.818 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T21:37:25.840 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-29T21:37:25.908 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-11-29T21:37:25.941 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-29T21:37:26.062 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2023-11-29T21:37:26.087 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com