2024-01-28T00:19:47.209 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f
2024-01-28T00:19:47.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:19:47.353 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2377ffbf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2378f9fc10>, signals=[15])
2024-01-28T00:19:47.353 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2024-01-28T00:19:47.354 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2024-01-28T00:19:47.354 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-01-28T00:19:47.373 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2024-01-28T00:19:47.373 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2024-01-28T00:19:47.373 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-01-28T00:19:47.486 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-28T00:19:47.512 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-28T00:19:47.524 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6
2024-01-28T00:19:47.551 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.6
2024-01-28T00:19:47.790 INFO:teuthology.orchestra.console.smithi112:Power off
2024-01-28T00:19:47.791 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T00:19:47.803 INFO:teuthology.orchestra.console.smithi132:Power off
2024-01-28T00:19:47.803 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T00:19:47.813 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-01-28T00:19:47.813 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:47.827 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2024-01-28T00:19:47.828 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:47.834 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-01-28T00:19:47.851 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2024-01-28T00:19:47.936 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-01-28T00:19:48.036 INFO:teuthology.orchestra.console.smithi112:Power on
2024-01-28T00:19:48.036 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-28T00:19:48.058 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2024-01-28T00:19:48.059 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:48.078 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-01-28T00:19:51.856 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:51.965 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2024-01-28T00:19:52.080 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:52.188 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2024-01-28T00:19:52.289 INFO:teuthology.orchestra.console.smithi112:Power on completed
2024-01-28T00:19:52.389 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2024-01-28T00:19:55.970 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:56.078 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-01-28T00:19:56.179 INFO:teuthology.orchestra.console.smithi132:Power off completed
2024-01-28T00:19:56.280 INFO:teuthology.orchestra.console.smithi132:Power on
2024-01-28T00:19:56.280 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-28T00:19:56.300 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2024-01-28T00:19:56.300 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:19:56.321 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-01-28T00:20:00.324 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:20:00.432 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-01-28T00:20:04.436 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:20:04.651 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2024-01-28T00:20:04.752 INFO:teuthology.orchestra.console.smithi132:Power on completed
2024-01-28T00:20:04.852 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2024-01-28T00:22:35.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:22:36.130 ERROR:teuthology.orchestra.connection:Error authenticating with smithi132.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-01-28T00:22:38.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:22:56.828 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:23:02.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:05.884 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:23:11.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:14.748 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-01-28T00:23:14.940 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:23:20.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:20.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:23.804 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-01-28T00:23:23.996 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:23:29.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:29.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:32.863 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2024-01-28T00:23:38.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:48.540 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:23:54.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:23:57.596 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:24:03.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:24:06.652 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2024-01-28T00:24:12.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:24:13.238 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-28T00:24:13.239 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-28T00:24:28.951 INFO:teuthology.provision.fog.smithi112:Node is ready
2024-01-28T00:24:28.952 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2024-01-28T00:24:29.013 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com
2024-01-28T00:24:29.013 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts
2024-01-28T00:24:29.072 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2024-01-28T00:24:29.072 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-01-28T00:24:29.201 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts
2024-01-28T00:24:29.229 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2024-01-28T00:24:29.297 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname
2024-01-28T00:24:29.364 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2024-01-28T00:24:29.430 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-01-28T00:24:29.487 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-28T00:24:29.488 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-28T00:24:29.489 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2024-01-28T00:24:29.490 DEBUG:teuthology.parallel:result is None
2024-01-28T00:24:38.867 WARNING:teuthology.provision.fog.smithi132:timed out
2024-01-28T00:24:44.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:24:45.089 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-28T00:24:45.089 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-28T00:24:45.358 INFO:teuthology.provision.fog.smithi132:Node is ready
2024-01-28T00:24:45.359 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2024-01-28T00:24:45.376 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2024-01-28T00:24:45.377 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2024-01-28T00:24:45.437 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2024-01-28T00:24:45.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-01-28T00:24:45.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2024-01-28T00:24:45.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2024-01-28T00:24:45.636 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2024-01-28T00:24:45.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2024-01-28T00:24:45.770 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-28T00:24:45.826 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-28T00:24:45.827 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-28T00:24:45.827 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2024-01-28T00:24:45.828 DEBUG:teuthology.parallel:result is None
2024-01-28T00:24:45.976 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2024-01-28T00:24:45.976 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-28T00:24:46.005 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2024-01-28T00:24:46.005 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-28T00:24:46.022 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2024-01-28T00:24:46.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-01-28T00:24:46.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:24:46.097 DEBUG:teuthology.orchestra.run.smithi112:> true
2024-01-28T00:24:46.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2024-01-28T00:24:46.229 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2024-01-28T00:24:46.286 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2024-01-28T00:24:46.286 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-28T00:24:46.344 INFO:teuthology.orchestra.run.smithi112.stdout:
2024-01-28T00:24:46.345 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-28T00:24:46.345 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-28T00:24:46.345 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-28T00:24:46.345 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-28T00:24:46.345 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2024-01-28T00:24:46.363 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2024-01-28T00:24:46.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-01-28T00:24:46.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-28T00:24:46.432 DEBUG:teuthology.orchestra.run.smithi132:> true
2024-01-28T00:24:46.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2024-01-28T00:24:46.497 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2024-01-28T00:24:46.556 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2024-01-28T00:24:46.557 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-28T00:24:46.617 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-28T00:24:46.618 INFO:teuthology.orchestra.run.smithi132.stdout:
2024-01-28T00:24:46.618 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-28T00:24:46.618 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-28T00:24:46.618 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-28T00:24:46.618 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-28T00:24:46.618 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2024-01-28T00:24:46.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:24:46.748 INFO:teuthology.dispatcher.supervisor:Running job 7535242
2024-01-28T00:24:46.749 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi/7535242 --name yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi/7535242/orig.config.yaml
2024-01-28T00:24:46.751 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi/7535242
2024-01-28T00:24:46.751 INFO:teuthology.dispatcher.supervisor:Job PID: 2791468
2024-01-28T00:24:46.751 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-28T00:26:46.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:28:46.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:30:46.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:32:46.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:34:47.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:36:47.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:38:47.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:40:47.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:42:47.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:44:47.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-28T00:44:47.455 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-28T00:44:47.551 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-28T00:44:47.552 INFO:teuthology.nuke:Checking targets against current locks
2024-01-28T00:44:47.603 DEBUG:teuthology.nuke:shortname: smithi112
2024-01-28T00:44:47.603 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-28T00:44:47.624 DEBUG:teuthology.nuke:shortname: smithi132
2024-01-28T00:44:47.624 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-28T00:44:47.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi/7535242', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-28 00:19:46.239942', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYpnazLFW8EZy9eq7m+VLE3vybM1mIfMLs15H4fO4kuf24cXt9Sawb7kOwyFvKN0Nf7pxs6BsS41EbD2RgGLo8='}
2024-01-28T00:44:47.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-26_17:09:47-rgw-pacific-release-distro-default-smithi/7535242', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-28 00:19:46.241344', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKnmKWI1ROb5tPKCgV+ugNH6cgbA7pRxWONFsHfJeMzghUZOTWL+gLpEED47inoaIOhXWmaFbjfH3J2LH74TXDU='}
2024-01-28T00:44:47.675 INFO:teuthology.orchestra.console.smithi112:Power off
2024-01-28T00:44:47.676 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T00:44:47.697 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2024-01-28T00:44:47.697 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:44:47.715 INFO:teuthology.orchestra.console.smithi132:Power off
2024-01-28T00:44:47.716 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-28T00:44:47.724 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2024-01-28T00:44:47.736 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2024-01-28T00:44:47.736 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-28T00:44:47.758 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2024-01-28T00:44:47.825 INFO:teuthology.orchestra.console.smithi112:Power off completed
2024-01-28T00:44:47.860 INFO:teuthology.orchestra.console.smithi132:Power off completed
2024-01-28T00:44:47.971 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com
2024-01-28T00:44:48.006 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com