2024-04-18T06:09:05.616 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d
2024-04-18T06:09:05.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:09:05.808 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f02b821cf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f02b9253c10>, signals=[15])
2024-04-18T06:09:05.809 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2024-04-18T06:09:05.809 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T06:09:05.809 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-04-18T06:09:05.831 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging
2024-04-18T06:09:05.831 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T06:09:05.831 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2024-04-18T06:09:05.856 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2024-04-18T06:09:05.857 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2024-04-18T06:09:05.857 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2024-04-18T06:09:05.952 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T06:09:05.976 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T06:09:05.985 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_rhel_8.6 (ID 5)
2024-04-18T06:09:05.993 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of rhel 8.6
2024-04-18T06:09:06.032 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.6
2024-04-18T06:09:06.041 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of rhel 8.6
2024-04-18T06:09:06.223 INFO:teuthology.orchestra.console.smithi019:Power off
2024-04-18T06:09:06.223 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T06:09:06.244 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2024-04-18T06:09:06.244 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:06.257 INFO:teuthology.orchestra.console.smithi167:Power off
2024-04-18T06:09:06.257 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T06:09:06.270 INFO:teuthology.orchestra.console.smithi203:Power off
2024-04-18T06:09:06.271 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-18T06:09:06.279 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off
2024-04-18T06:09:06.279 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:06.286 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-04-18T06:09:06.292 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2024-04-18T06:09:06.292 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:06.303 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-04-18T06:09:06.313 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-04-18T06:09:06.387 INFO:teuthology.orchestra.console.smithi019:Power off completed
2024-04-18T06:09:06.404 INFO:teuthology.orchestra.console.smithi167:Power off completed
2024-04-18T06:09:06.413 INFO:teuthology.orchestra.console.smithi203:Power off completed
2024-04-18T06:09:06.489 INFO:teuthology.orchestra.console.smithi019:Power on
2024-04-18T06:09:06.489 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T06:09:06.504 INFO:teuthology.orchestra.console.smithi167:Power on
2024-04-18T06:09:06.505 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T06:09:06.513 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On
2024-04-18T06:09:06.514 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:06.524 INFO:teuthology.orchestra.console.smithi203:Power on
2024-04-18T06:09:06.525 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-18T06:09:06.533 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On
2024-04-18T06:09:06.534 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:06.542 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-04-18T06:09:06.545 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2024-04-18T06:09:06.546 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:06.556 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-04-18T06:09:06.568 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-04-18T06:09:10.546 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:10.557 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:10.569 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:10.657 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2024-04-18T06:09:10.666 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off
2024-04-18T06:09:10.679 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2024-04-18T06:09:14.662 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:14.669 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:14.680 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-18T06:09:14.772 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2024-04-18T06:09:14.778 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on
2024-04-18T06:09:14.789 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2024-04-18T06:09:14.873 INFO:teuthology.orchestra.console.smithi019:Power on completed
2024-04-18T06:09:14.879 INFO:teuthology.orchestra.console.smithi167:Power on completed
2024-04-18T06:09:14.890 INFO:teuthology.orchestra.console.smithi203:Power on completed
2024-04-18T06:09:14.974 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2024-04-18T06:09:14.980 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish
2024-04-18T06:09:14.991 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2024-04-18T06:11:47.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:03.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:06.302 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-18T06:12:12.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:15.390 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-18T06:12:21.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:21.406 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-04-18T06:12:24.449 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-18T06:12:27.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:30.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:30.462 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-04-18T06:12:33.502 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2024-04-18T06:12:36.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:39.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:39.518 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-04-18T06:12:45.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:48.578 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-04-18T06:12:54.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:12:57.662 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2024-04-18T06:13:03.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:03.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:06.942 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:13:12.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:15.998 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:13:22.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:25.054 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:13:31.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:34.110 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:13:39.514 WARNING:teuthology.provision.fog.smithi019:timed out
2024-04-18T06:13:40.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:43.166 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:13:45.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:45.807 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T06:13:45.807 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T06:13:46.101 INFO:teuthology.provision.fog.smithi019:Node is ready
2024-04-18T06:13:46.101 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2024-04-18T06:13:46.122 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2024-04-18T06:13:46.122 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts
2024-04-18T06:13:46.183 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2024-04-18T06:13:46.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-04-18T06:13:46.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts
2024-04-18T06:13:46.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts
2024-04-18T06:13:46.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname
2024-04-18T06:13:46.476 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2024-04-18T06:13:46.551 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:ID="rhel"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="fedora"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8.6"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-04-18T06:13:46.613 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T06:13:46.614 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T06:13:46.615 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2024-04-18T06:13:46.616 DEBUG:teuthology.parallel:result is None
2024-04-18T06:13:49.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:13:52.222 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:13:58.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:14:01.310 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167
2024-04-18T06:14:03.674 WARNING:teuthology.provision.fog.smithi203:timed out
2024-04-18T06:14:07.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:14:09.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:14:09.894 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T06:14:09.895 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T06:14:10.143 INFO:teuthology.provision.fog.smithi203:Node is ready
2024-04-18T06:14:10.143 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2024-04-18T06:14:10.161 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2024-04-18T06:14:10.161 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2024-04-18T06:14:10.219 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2024-04-18T06:14:10.220 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2024-04-18T06:14:10.346 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2024-04-18T06:14:10.374 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2024-04-18T06:14:10.442 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2024-04-18T06:14:10.511 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2024-04-18T06:14:10.578 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T06:14:10.635 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T06:14:10.636 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T06:14:10.636 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2024-04-18T06:14:10.637 DEBUG:teuthology.parallel:result is None
2024-04-18T06:15:07.362 WARNING:teuthology.provision.fog.smithi167:timed out
2024-04-18T06:15:13.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:15:13.615 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-18T06:15:13.615 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-18T06:15:13.847 INFO:teuthology.provision.fog.smithi167:Node is ready
2024-04-18T06:15:13.848 DEBUG:teuthology.orchestra.run.smithi167:> hostname
2024-04-18T06:15:13.906 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com
2024-04-18T06:15:13.906 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts
2024-04-18T06:15:13.964 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167
2024-04-18T06:15:13.965 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2024-04-18T06:15:14.083 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts
2024-04-18T06:15:14.113 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts
2024-04-18T06:15:14.183 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname
2024-04-18T06:15:14.251 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167
2024-04-18T06:15:14.319 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T06:15:14.376 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T06:15:14.377 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T06:15:14.377 INFO:teuthology.provision.fog.smithi167:Deploy complete!
2024-04-18T06:15:14.378 DEBUG:teuthology.parallel:result is None
2024-04-18T06:15:14.600 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2024-04-18T06:15:14.600 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T06:15:14.622 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com
2024-04-18T06:15:14.622 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T06:15:14.646 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2024-04-18T06:15:14.646 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-18T06:15:14.664 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2024-04-18T06:15:14.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-04-18T06:15:14.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:15:14.740 DEBUG:teuthology.orchestra.run.smithi019:> true
2024-04-18T06:15:14.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com'
2024-04-18T06:15:14.886 DEBUG:teuthology.orchestra.run.smithi019:> uname -m
2024-04-18T06:15:14.947 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2024-04-18T06:15:14.947 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:ID="rhel"
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="fedora"
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8.6"
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8"
2024-04-18T06:15:15.008 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T06:15:15.009 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T06:15:15.010 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2024-04-18T06:15:15.030 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server
2024-04-18T06:15:15.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com'
2024-04-18T06:15:15.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:15:15.102 DEBUG:teuthology.orchestra.run.smithi167:> true
2024-04-18T06:15:15.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com'
2024-04-18T06:15:15.173 DEBUG:teuthology.orchestra.run.smithi167:> uname -m
2024-04-18T06:15:15.232 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64
2024-04-18T06:15:15.233 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel"
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora"
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.6"
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8"
2024-04-18T06:15:15.292 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T06:15:15.293 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T06:15:15.294 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server
2024-04-18T06:15:15.313 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2024-04-18T06:15:15.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2024-04-18T06:15:15.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-18T06:15:15.385 DEBUG:teuthology.orchestra.run.smithi203:> true
2024-04-18T06:15:15.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2024-04-18T06:15:15.524 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2024-04-18T06:15:15.582 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2024-04-18T06:15:15.583 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Red Hat Enterprise Linux"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8.6 (Ootpa)"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:ID="rhel"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="fedora"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8.6"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-04-18T06:15:15.640 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.redhat.com/"
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-04-18T06:15:15.641 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-04-18T06:15:15.641 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2024-04-18T06:15:15.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:15:15.765 INFO:teuthology.dispatcher.supervisor:Running job 7661625
2024-04-18T06:15:15.766 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661625 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661625/orig.config.yaml
2024-04-18T06:15:15.769 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661625
2024-04-18T06:15:15.769 INFO:teuthology.dispatcher.supervisor:Job PID: 1897693
2024-04-18T06:15:15.769 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-18T06:17:15.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:19:16.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:21:16.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:23:16.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:25:16.574 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:27:16.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:29:16.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-18T06:29:17.001 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1