2024-01-16T03:56:51.188 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-16T03:56:51.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T03:56:51.330 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9dee449f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9def3afc10>, signals=[15])
2024-01-16T03:56:51.330 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2024-01-16T03:56:51.330 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T03:56:51.331 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-01-16T03:56:51.357 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2024-01-16T03:56:51.357 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2024-01-16T03:56:51.357 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2024-01-16T03:56:51.476 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-16T03:56:51.495 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_rhel_8.6 (ID 5)
2024-01-16T03:56:51.523 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.6
2024-01-16T03:56:51.546 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 8.6
2024-01-16T03:56:51.768 INFO:teuthology.orchestra.console.smithi133:Power off
2024-01-16T03:56:51.769 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T03:56:51.783 INFO:teuthology.orchestra.console.smithi107:Power off
2024-01-16T03:56:51.784 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T03:56:51.793 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2024-01-16T03:56:51.793 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:56:51.806 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-01-16T03:56:51.807 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:56:51.816 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2024-01-16T03:56:51.833 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-16T03:56:55.820 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:56:55.834 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:56:55.929 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2024-01-16T03:56:55.943 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-16T03:56:59.932 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:56:59.944 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:00.042 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2024-01-16T03:57:00.052 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-16T03:57:00.144 INFO:teuthology.orchestra.console.smithi133:Power off completed
2024-01-16T03:57:00.153 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-01-16T03:57:00.245 INFO:teuthology.orchestra.console.smithi133:Power on
2024-01-16T03:57:00.245 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T03:57:00.254 INFO:teuthology.orchestra.console.smithi107:Power on
2024-01-16T03:57:00.254 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-16T03:57:00.269 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On
2024-01-16T03:57:00.270 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:00.279 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On
2024-01-16T03:57:00.280 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:00.293 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2024-01-16T03:57:00.300 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-16T03:57:04.296 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:04.303 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:04.405 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2024-01-16T03:57:04.411 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-16T03:57:08.411 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:08.417 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T03:57:08.519 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2024-01-16T03:57:08.526 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-16T03:57:08.622 INFO:teuthology.orchestra.console.smithi133:Power on completed
2024-01-16T03:57:08.626 INFO:teuthology.orchestra.console.smithi107:Power on completed
2024-01-16T03:57:08.723 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2024-01-16T03:57:08.727 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2024-01-16T03:59:39.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T03:59:54.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T03:59:58.012 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2024-01-16T04:00:04.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:07.068 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2024-01-16T04:00:13.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:13.116 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-16T04:00:16.156 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2024-01-16T04:00:19.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:22.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:22.172 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-16T04:00:25.212 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2024-01-16T04:00:28.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:31.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:31.232 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-16T04:00:34.268 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2024-01-16T04:00:37.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:40.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:40.316 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-16T04:00:46.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:00:49.376 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-16T04:00:55.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:01:40.322 WARNING:teuthology.provision.fog.smithi133:timed out
2024-01-16T04:01:46.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:01:46.617 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T04:01:46.618 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T04:01:46.881 INFO:teuthology.provision.fog.smithi133:Node is ready
2024-01-16T04:01:46.881 DEBUG:teuthology.orchestra.run.smithi133:> hostname
2024-01-16T04:01:46.897 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133
2024-01-16T04:01:46.897 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133 /etc/hosts
2024-01-16T04:01:46.953 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2024-01-16T04:01:46.954 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2024-01-16T04:01:47.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133/smithi133/g' /etc/hosts
2024-01-16T04:01:47.088 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts
2024-01-16T04:01:47.156 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133/smithi133/g' /etc/hostname
2024-01-16T04:01:47.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2024-01-16T04:01:47.290 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-16T04:01:47.346 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/"
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-16T04:01:47.347 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-16T04:01:47.348 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2024-01-16T04:01:47.349 DEBUG:teuthology.parallel:result is None
2024-01-16T04:01:55.392 WARNING:teuthology.provision.fog.smithi107:timed out
2024-01-16T04:02:01.397 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:02:01.613 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-16T04:02:01.613 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-16T04:02:01.868 INFO:teuthology.provision.fog.smithi107:Node is ready
2024-01-16T04:02:01.868 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2024-01-16T04:02:01.926 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2024-01-16T04:02:01.926 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2024-01-16T04:02:01.984 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2024-01-16T04:02:01.985 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-01-16T04:02:02.105 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2024-01-16T04:02:02.137 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2024-01-16T04:02:02.207 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2024-01-16T04:02:02.276 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-01-16T04:02:02.343 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-01-16T04:02:02.400 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux"
2024-01-16T04:02:02.400 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)"
2024-01-16T04:02:02.400 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel"
2024-01-16T04:02:02.400 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-16T04:02:02.401 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-16T04:02:02.401 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2024-01-16T04:02:02.402 DEBUG:teuthology.parallel:result is None
2024-01-16T04:02:02.552 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2024-01-16T04:02:02.553 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T04:02:02.577 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2024-01-16T04:02:02.577 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-16T04:02:02.594 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2024-01-16T04:02:02.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-01-16T04:02:02.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:02:02.665 DEBUG:teuthology.orchestra.run.smithi107:> true
2024-01-16T04:02:02.687 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-01-16T04:02:02.687 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2024-01-16T04:02:02.743 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2024-01-16T04:02:02.744 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.6 (Ootpa)"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.6"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/"
2024-01-16T04:02:02.801 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-16T04:02:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-16T04:02:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:
2024-01-16T04:02:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-16T04:02:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-16T04:02:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-16T04:02:02.802 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-16T04:02:02.802 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-01-16T04:02:02.860 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2024-01-16T04:02:02.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2024-01-16T04:02:02.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-16T04:02:02.934 DEBUG:teuthology.orchestra.run.smithi133:> true
2024-01-16T04:02:03.069 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com'
2024-01-16T04:02:03.070 DEBUG:teuthology.orchestra.run.smithi133:> uname -m
2024-01-16T04:02:03.127 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2024-01-16T04:02:03.128 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2024-01-16T04:02:03.185 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux"
2024-01-16T04:02:03.185 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.6 (Ootpa)"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.6"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-16T04:02:03.186 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-01-16T04:02:03.187 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-01-16T04:02:03.187 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-01-16T04:02:03.187 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2024-01-16T04:02:03.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:02:03.334 INFO:teuthology.dispatcher.supervisor:Running job 7517303
2024-01-16T04:02:03.335 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-15_22:05:22-rgw-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7517303 --name yuriw-2024-01-15_22:05:22-rgw-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zones supported-random-distro$/{rhel_8} tasks/test_multi} -- /home/teuthworker/archive/yuriw-2024-01-15_22:05:22-rgw-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7517303/orig.config.yaml
2024-01-16T04:02:03.338 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-15_22:05:22-rgw-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7517303
2024-01-16T04:02:03.338 INFO:teuthology.dispatcher.supervisor:Job PID: 486239
2024-01-16T04:02:03.338 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-16T04:04:03.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:06:03.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:08:03.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:10:03.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:12:04.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:14:04.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:16:04.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:18:04.595 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:20:04.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:22:04.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:24:04.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-16T04:24:05.050 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-16T04:24:05.140 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-16T04:24:05.140 INFO:teuthology.nuke:Checking targets against current locks
2024-01-16T04:24:05.189 DEBUG:teuthology.nuke:shortname: smithi107
2024-01-16T04:24:05.189 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-16T04:24:05.209 DEBUG:teuthology.nuke:shortname: smithi133
2024-01-16T04:24:05.209 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-16T04:24:05.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-15_22:05:22-rgw-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7517303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-16 03:56:50.132059', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJYg19NOm7nct0O5eYslDerbHzgwKHd9suCCJUUvc7k9oQONsclGc8pSBy8/03l8ay7J2HZsNcQPd0Vp41Zc8kc='}
2024-01-16T04:24:05.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-15_22:05:22-rgw-wip-yuri5-testing-2024-01-11-1300-pacific-distro-default-smithi/7517303', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-16 03:56:50.129502', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOeTSOQQHxRZi6j6+/xZ1YBtHJjFMZ0DyFW9juv1hEPeKRtxIv2BngJropT5nKv6JWLFPF3MeUkuLwdILrOZt3Q='}
2024-01-16T04:24:05.263 INFO:teuthology.orchestra.console.smithi107:Power off
2024-01-16T04:24:05.264 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T04:24:05.285 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-01-16T04:24:05.286 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T04:24:05.301 INFO:teuthology.orchestra.console.smithi133:Power off
2024-01-16T04:24:05.301 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-16T04:24:05.309 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-16T04:24:05.322 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2024-01-16T04:24:05.322 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-16T04:24:05.342 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2024-01-16T04:24:05.410 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-01-16T04:24:05.443 INFO:teuthology.orchestra.console.smithi133:Power off completed
2024-01-16T04:24:05.565 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com
2024-01-16T04:24:05.589 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com