2024-04-18T04:52:19.163 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T04:52:19.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T04:52:19.345 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7eff4ec5bf70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7eff4fcbcc10>, signals=[15])
2024-04-18T04:52:19.346 INFO:teuthology.lock.ops:Start node 'smithi047.front.sepia.ceph.com' reimaging
2024-04-18T04:52:19.346 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T04:52:19.346 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2024-04-18T04:52:19.362 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2024-04-18T04:52:19.362 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T04:52:19.363 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-04-18T04:52:19.379 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging
2024-04-18T04:52:19.379 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T04:52:19.379 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-04-18T04:52:19.470 DEBUG:teuthology.provision.fog.smithi047:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T04:52:19.512 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T04:52:19.513 INFO:teuthology.provision.fog.smithi047:Scheduling deploy of rhel 8.6
2024-04-18T04:52:19.562 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6
2024-04-18T04:52:19.576 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T04:52:19.612 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of rhel 8.6
2024-04-18T04:52:19.812 INFO:teuthology.orchestra.console.smithi047:Power off
2024-04-18T04:52:19.812 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T04:52:19.834 DEBUG:teuthology.orchestra.console.smithi047:power off output: Chassis Power Control: Down/Off
2024-04-18T04:52:19.835 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:19.855 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off
2024-04-18T04:52:19.926 INFO:teuthology.orchestra.console.smithi142:Power off
2024-04-18T04:52:19.926 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T04:52:19.938 INFO:teuthology.orchestra.console.smithi136:Power off
2024-04-18T04:52:19.939 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T04:52:19.949 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off
2024-04-18T04:52:19.950 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:19.956 INFO:teuthology.orchestra.console.smithi047:Power off completed
2024-04-18T04:52:19.959 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2024-04-18T04:52:19.959 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:19.970 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-18T04:52:19.980 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-04-18T04:52:20.058 INFO:teuthology.orchestra.console.smithi047:Power on
2024-04-18T04:52:20.058 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T04:52:20.071 INFO:teuthology.orchestra.console.smithi142:Power off completed
2024-04-18T04:52:20.081 INFO:teuthology.orchestra.console.smithi136:Power off completed
2024-04-18T04:52:20.087 DEBUG:teuthology.orchestra.console.smithi047:power on output: Chassis Power Control: Up/On
2024-04-18T04:52:20.087 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:20.112 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is off
2024-04-18T04:52:20.172 INFO:teuthology.orchestra.console.smithi142:Power on
2024-04-18T04:52:20.172 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T04:52:20.181 INFO:teuthology.orchestra.console.smithi136:Power on
2024-04-18T04:52:20.182 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T04:52:20.193 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On
2024-04-18T04:52:20.193 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:20.203 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2024-04-18T04:52:20.203 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:20.217 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-18T04:52:20.227 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-04-18T04:52:24.117 DEBUG:teuthology.orchestra.console.smithi047:pexpect command: ipmitool -H smithi047.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:24.218 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:24.226 DEBUG:teuthology.orchestra.console.smithi047:check power output: Chassis Power is on
2024-04-18T04:52:24.228 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:24.327 INFO:teuthology.orchestra.console.smithi047:Power on completed
2024-04-18T04:52:24.328 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off
2024-04-18T04:52:24.337 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2024-04-18T04:52:24.429 INFO:teuthology.provision.fog.smithi047:Waiting for deploy to finish
2024-04-18T04:52:28.330 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:28.337 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T04:52:28.440 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on
2024-04-18T04:52:28.445 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2024-04-18T04:52:28.541 INFO:teuthology.orchestra.console.smithi142:Power on completed
2024-04-18T04:52:28.546 INFO:teuthology.orchestra.console.smithi136:Power on completed
2024-04-18T04:52:28.642 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish
2024-04-18T04:52:28.647 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2024-04-18T04:56:00.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:19.231 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:56:25.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:26.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:27.202 ERROR:teuthology.orchestra.connection:Error authenticating with smithi047.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2024-04-18T04:56:28.290 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:56:30.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:33.982 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-18T04:56:34.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:37.342 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:56:39.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:43.038 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-18T04:56:43.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:46.398 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:56:49.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:52.094 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-18T04:56:52.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:56:55.458 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:56:58.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:01.150 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-18T04:57:01.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:07.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:07.550 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:57:10.206 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-18T04:57:13.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:16.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:16.610 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:57:19.262 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2024-04-18T04:57:22.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:25.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:25.662 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:57:31.205 WARNING:teuthology.provision.fog.smithi047:timed out
2024-04-18T04:57:31.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:34.722 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142
2024-04-18T04:57:37.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:40.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:57:41.395 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T04:57:41.395 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T04:57:55.746 WARNING:teuthology.provision.fog.smithi047:[Errno None] Unable to connect to port 22 on 172.21.15.47
2024-04-18T04:57:57.031 INFO:teuthology.provision.fog.smithi142:Node is ready
2024-04-18T04:57:57.031 DEBUG:teuthology.orchestra.run.smithi142:> hostname
2024-04-18T04:57:57.052 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com
2024-04-18T04:57:57.053 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts
2024-04-18T04:57:57.112 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142
2024-04-18T04:57:57.112 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-18T04:57:57.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts
2024-04-18T04:57:57.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts
2024-04-18T04:57:57.337 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname
2024-04-18T04:57:57.405 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142
2024-04-18T04:57:57.472 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T04:57:57.530 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T04:57:57.531 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T04:57:57.532 INFO:teuthology.provision.fog.smithi142:Deploy complete!
2024-04-18T04:57:57.533 DEBUG:teuthology.parallel:result is None
2024-04-18T04:58:01.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:58:01.951 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T04:58:01.951 DEBUG:teuthology.orchestra.run.smithi047:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T04:58:17.962 INFO:teuthology.provision.fog.smithi047:Node is ready
2024-04-18T04:58:17.963 DEBUG:teuthology.orchestra.run.smithi047:> hostname
2024-04-18T04:58:17.986 INFO:teuthology.orchestra.run.smithi047.stdout:smithi045
2024-04-18T04:58:17.986 DEBUG:teuthology.orchestra.run.smithi047:> grep smithi045 /etc/hosts
2024-04-18T04:58:18.047 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-04-18T04:58:18.047 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i -e 's/smithi045/smithi047/g' /etc/hostname
2024-04-18T04:58:18.178 DEBUG:teuthology.orchestra.run.smithi047:> sudo hostname smithi047
2024-04-18T04:58:18.210 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release
2024-04-18T04:58:18.271 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T04:58:18.272 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T04:58:18.273 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T04:58:18.273 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T04:58:18.273 INFO:teuthology.provision.fog.smithi047:Deploy complete!
2024-04-18T04:58:18.274 DEBUG:teuthology.parallel:result is None
2024-04-18T04:58:25.267 WARNING:teuthology.provision.fog.smithi136:timed out
2024-04-18T04:58:31.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:58:31.492 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T04:58:31.492 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T04:58:31.735 INFO:teuthology.provision.fog.smithi136:Node is ready
2024-04-18T04:58:31.736 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2024-04-18T04:58:31.753 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136
2024-04-18T04:58:31.753 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136 /etc/hosts
2024-04-18T04:58:31.811 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2024-04-18T04:58:31.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-04-18T04:58:31.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hosts
2024-04-18T04:58:31.962 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2024-04-18T04:58:32.029 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136/smithi136/g' /etc/hostname
2024-04-18T04:58:32.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2024-04-18T04:58:32.163 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T04:58:32.220 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T04:58:32.221 INFO:teuthology.orchestra.run.smithi136.stdout:
2024-04-18T04:58:32.221 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T04:58:32.221 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T04:58:32.221 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T04:58:32.221 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T04:58:32.221 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2024-04-18T04:58:32.222 DEBUG:teuthology.parallel:result is None
2024-04-18T04:58:32.415 INFO:teuthology.lock.ops:Checking smithi047.front.sepia.ceph.com
2024-04-18T04:58:32.416 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T04:58:32.444 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2024-04-18T04:58:32.444 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T04:58:32.460 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com
2024-04-18T04:58:32.460 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T04:58:32.478 INFO:teuthology.lock.ops:Updating [smithi047.front.sepia.ceph.com]: set os type and version on server
2024-04-18T04:58:32.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com'
2024-04-18T04:58:32.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:58:32.552 DEBUG:teuthology.orchestra.run.smithi047:> true
2024-04-18T04:58:32.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com'
2024-04-18T04:58:32.628 DEBUG:teuthology.orchestra.run.smithi047:> uname -m
2024-04-18T04:58:32.689 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64
2024-04-18T04:58:32.689 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:ID="rhel"
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="fedora"
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8.6"
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8"
2024-04-18T04:58:32.750 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T04:58:32.751 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T04:58:32.752 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server
2024-04-18T04:58:32.769 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2024-04-18T04:58:32.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-04-18T04:58:32.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:58:32.838 DEBUG:teuthology.orchestra.run.smithi136:> true
2024-04-18T04:58:32.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2024-04-18T04:58:32.903 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2024-04-18T04:58:32.960 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2024-04-18T04:58:32.960 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T04:58:33.017 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T04:58:33.018 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T04:58:33.019 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2024-04-18T04:58:33.044 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server
2024-04-18T04:58:33.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-04-18T04:58:33.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T04:58:33.119 DEBUG:teuthology.orchestra.run.smithi142:> true
2024-04-18T04:58:33.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com'
2024-04-18T04:58:33.256 DEBUG:teuthology.orchestra.run.smithi142:> uname -m
2024-04-18T04:58:33.314 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64
2024-04-18T04:58:33.314 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release
2024-04-18T04:58:33.371 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T04:58:33.371 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T04:58:33.371 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T04:58:33.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T04:58:33.373 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server
2024-04-18T04:58:33.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T04:58:33.488 INFO:teuthology.dispatcher.supervisor:Running job 7661562
2024-04-18T04:58:33.488 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661562 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661562/orig.config.yaml
2024-04-18T04:58:33.491 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661562
2024-04-18T04:58:33.491 INFO:teuthology.dispatcher.supervisor:Job PID: 1406786
2024-04-18T04:58:33.491 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T05:00:33.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:02:33.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:04:33.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:06:33.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:08:33.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:10:33.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:12:33.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T05:12:34.016 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1