2024-01-24T09:29:37.446 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-24T09:29:37.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:29:37.584 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7feab6469f70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7feab74cfc10>, signals=[15])
2024-01-24T09:29:37.584 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging
2024-01-24T09:29:37.585 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T09:29:37.585 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-01-24T09:29:37.608 INFO:teuthology.lock.ops:Start node 'smithi194.front.sepia.ceph.com' reimaging
2024-01-24T09:29:37.608 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: reset os type and version on server
2024-01-24T09:29:37.608 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-01-24T09:29:37.723 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T09:29:37.746 DEBUG:teuthology.provision.fog.smithi194:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-24T09:29:37.768 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of rhel 8.6
2024-01-24T09:29:37.797 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of rhel 8.6
2024-01-24T09:29:37.981 INFO:teuthology.orchestra.console.smithi119:Power off
2024-01-24T09:29:37.981 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T09:29:37.995 INFO:teuthology.orchestra.console.smithi194:Power off
2024-01-24T09:29:37.995 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T09:29:38.004 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-01-24T09:29:38.004 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:38.017 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-01-24T09:29:38.017 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:38.028 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T09:29:38.040 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T09:29:38.129 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-01-24T09:29:38.141 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-01-24T09:29:38.230 INFO:teuthology.orchestra.console.smithi119:Power on
2024-01-24T09:29:38.231 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T09:29:38.241 INFO:teuthology.orchestra.console.smithi194:Power on
2024-01-24T09:29:38.242 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-24T09:29:38.253 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On
2024-01-24T09:29:38.253 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:38.262 DEBUG:teuthology.orchestra.console.smithi194:power on output: Chassis Power Control: Up/On
2024-01-24T09:29:38.263 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:38.274 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T09:29:38.286 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T09:29:42.276 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:42.286 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:42.385 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T09:29:42.394 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T09:29:46.389 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:46.397 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:29:46.500 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on
2024-01-24T09:29:46.506 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on
2024-01-24T09:29:46.602 INFO:teuthology.orchestra.console.smithi119:Power on completed
2024-01-24T09:29:46.607 INFO:teuthology.orchestra.console.smithi194:Power on completed
2024-01-24T09:29:46.703 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish
2024-01-24T09:29:46.708 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish
2024-01-24T09:32:17.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:32:17.899 ERROR:teuthology.orchestra.connection:Error authenticating with smithi119.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-24T09:32:32.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:32:51.132 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T09:32:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:33:00.192 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T09:33:06.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:33:09.244 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T09:33:15.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:33:18.300 WARNING:teuthology.provision.fog.smithi194:[Errno None] Unable to connect to port 22 on 172.21.15.194
2024-01-24T09:33:21.902 WARNING:teuthology.provision.fog.smithi119:timed out
2024-01-24T09:33:24.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:33:27.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:33:46.431 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T09:33:52.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:33:55.488 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119
2024-01-24T09:34:01.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:34:01.748 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T09:34:01.749 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T09:34:22.115 INFO:teuthology.provision.fog.smithi119:Node is ready
2024-01-24T09:34:22.115 DEBUG:teuthology.orchestra.run.smithi119:> hostname
2024-01-24T09:34:22.177 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com
2024-01-24T09:34:22.178 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts
2024-01-24T09:34:22.237 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119
2024-01-24T09:34:22.238 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-01-24T09:34:22.364 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts
2024-01-24T09:34:22.395 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts
2024-01-24T09:34:22.464 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname
2024-01-24T09:34:22.532 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119
2024-01-24T09:34:22.600 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-01-24T09:34:22.657 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T09:34:22.658 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T09:34:22.659 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-01-24T09:34:22.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T09:34:22.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T09:34:22.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T09:34:22.659 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T09:34:22.660 INFO:teuthology.provision.fog.smithi119:Deploy complete!
2024-01-24T09:34:22.661 DEBUG:teuthology.parallel:result is None
2024-01-24T09:34:24.304 WARNING:teuthology.provision.fog.smithi194:timed out
2024-01-24T09:34:30.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:34:30.525 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-24T09:34:30.525 DEBUG:teuthology.orchestra.run.smithi194:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-24T09:34:30.762 INFO:teuthology.provision.fog.smithi194:Node is ready
2024-01-24T09:34:30.762 DEBUG:teuthology.orchestra.run.smithi194:> hostname
2024-01-24T09:34:30.819 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194
2024-01-24T09:34:30.819 DEBUG:teuthology.orchestra.run.smithi194:> grep smithi194 /etc/hosts
2024-01-24T09:34:30.877 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194
2024-01-24T09:34:30.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-01-24T09:34:30.990 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hosts
2024-01-24T09:34:31.018 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/172.21.15.194/172.21.15.194/g' /etc/hosts
2024-01-24T09:34:31.086 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i -e 's/smithi194/smithi194/g' /etc/hostname
2024-01-24T09:34:31.153 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname smithi194
2024-01-24T09:34:31.219 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-01-24T09:34:31.276 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T09:34:31.276 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T09:34:31.276 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel"
2024-01-24T09:34:31.276 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora"
2024-01-24T09:34:31.276 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:
2024-01-24T09:34:31.277 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T09:34:31.278 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T09:34:31.278 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T09:34:31.278 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T09:34:31.278 INFO:teuthology.provision.fog.smithi194:Deploy complete!
2024-01-24T09:34:31.278 DEBUG:teuthology.parallel:result is None
2024-01-24T09:34:31.430 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com
2024-01-24T09:34:31.430 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T09:34:31.466 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com
2024-01-24T09:34:31.466 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-24T09:34:31.492 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server
2024-01-24T09:34:31.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-01-24T09:34:31.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:34:31.575 DEBUG:teuthology.orchestra.run.smithi119:> true
2024-01-24T09:34:31.650 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com'
2024-01-24T09:34:31.651 DEBUG:teuthology.orchestra.run.smithi119:> uname -m
2024-01-24T09:34:31.710 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64
2024-01-24T09:34:31.710 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:ID="rhel"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="fedora"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="8.6"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el8"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31"
2024-01-24T09:34:31.770 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T09:34:31.771 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T09:34:31.772 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server
2024-01-24T09:34:31.799 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server
2024-01-24T09:34:31.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-01-24T09:34:31.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-24T09:34:31.882 DEBUG:teuthology.orchestra.run.smithi194:> true
2024-01-24T09:34:31.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com'
2024-01-24T09:34:31.948 DEBUG:teuthology.orchestra.run.smithi194:> uname -m
2024-01-24T09:34:32.005 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64
2024-01-24T09:34:32.005 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release
2024-01-24T09:34:32.062 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Red Hat Enterprise Linux"
2024-01-24T09:34:32.062 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="8.6 (Ootpa)"
2024-01-24T09:34:32.063 INFO:teuthology.orchestra.run.smithi194.stdout:ID="rhel"
2024-01-24T09:34:32.063 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="fedora"
2024-01-24T09:34:32.063 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="8.6"
2024-01-24T09:34:32.063 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el8"
2024-01-24T09:34:32.063 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-24T09:34:32.064 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31"
2024-01-24T09:34:32.064 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-24T09:34:32.064 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.redhat.com/"
2024-01-24T09:34:32.064 INFO:teuthology.orchestra.run.smithi194.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-24T09:34:32.064 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-24T09:34:32.065 INFO:teuthology.orchestra.run.smithi194.stdout:
2024-01-24T09:34:32.065 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-24T09:34:32.065 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-24T09:34:32.065 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-24T09:34:32.065 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-24T09:34:32.066 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server
2024-01-24T09:34:32.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:34:32.209 INFO:teuthology.dispatcher.supervisor:Running job 7528271
2024-01-24T09:34:32.209 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528271 --name vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/auto-repair} -- /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528271/orig.config.yaml
2024-01-24T09:34:32.212 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528271
2024-01-24T09:34:32.212 INFO:teuthology.dispatcher.supervisor:Job PID: 1812589
2024-01-24T09:34:32.213 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-24T09:36:32.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:38:32.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:40:32.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:42:32.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:44:32.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:46:32.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-24T09:46:32.682 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-24T09:46:32.804 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-24T09:46:32.804 INFO:teuthology.nuke:Checking targets against current locks
2024-01-24T09:46:32.847 DEBUG:teuthology.nuke:shortname: smithi119
2024-01-24T09:46:32.847 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T09:46:32.869 DEBUG:teuthology.nuke:shortname: smithi194
2024-01-24T09:46:32.869 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-24T09:46:32.873 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 09:29:36.395726', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNXdu5m4GjlcDddhUrVfTkgAysbYuL6+VfCqN3FiDBhVOu8/7ogaDiixY/JP0MV+3t5RxDDPboZ3y4QtrHF8NQ='}
2024-01-24T09:46:32.895 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-23_14:05:57-fs-wip-vshankar-testing1-reef-2024-01-23-1317-testing-default-smithi/7528271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-24 09:29:36.397288', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO4oqcVzSUk1PCGlG6QZdImA7fNbUjMi6UWPGPMNTdNLVgZEA7xO5hbqVXGkI0z6FQtjM9kogPqMzUeEugw/3ac='}
2024-01-24T09:46:32.934 INFO:teuthology.orchestra.console.smithi119:Power off
2024-01-24T09:46:32.934 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T09:46:32.959 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off
2024-01-24T09:46:32.959 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:46:32.975 INFO:teuthology.orchestra.console.smithi194:Power off
2024-01-24T09:46:32.975 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-24T09:46:32.982 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off
2024-01-24T09:46:32.995 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off
2024-01-24T09:46:32.995 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-24T09:46:33.016 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off
2024-01-24T09:46:33.084 INFO:teuthology.orchestra.console.smithi119:Power off completed
2024-01-24T09:46:33.117 INFO:teuthology.orchestra.console.smithi194:Power off completed
2024-01-24T09:46:33.238 INFO:teuthology.lock.ops:unlocked: smithi119.front.sepia.ceph.com
2024-01-24T09:46:33.262 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com