2024-03-11T18:29:44.464 INFO:root:teuthology version: 0.0.1.dev262+ge691533
2024-03-11T18:29:44.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:29:44.632 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fe4f97e1f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fe4fa842c10>, signals=[15])
2024-03-11T18:29:44.632 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging
2024-03-11T18:29:44.633 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T18:29:44.633 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-11T18:29:44.656 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2024-03-11T18:29:44.656 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T18:29:44.656 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-03-11T18:29:44.681 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging
2024-03-11T18:29:44.681 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server
2024-03-11T18:29:44.681 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2024-03-11T18:29:44.803 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-11T18:29:44.806 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-11T18:29:44.812 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_rhel_8.6 (ID 5)
2024-03-11T18:29:44.855 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of rhel 8.6
2024-03-11T18:29:44.861 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of rhel 8.6
2024-03-11T18:29:44.869 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of rhel 8.6
2024-03-11T18:29:45.097 INFO:teuthology.orchestra.console.smithi032:Power off
2024-03-11T18:29:45.098 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T18:29:45.112 INFO:teuthology.orchestra.console.smithi134:Power off
2024-03-11T18:29:45.113 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T18:29:45.125 INFO:teuthology.orchestra.console.smithi172:Power off
2024-03-11T18:29:45.125 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-03-11T18:29:45.134 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off
2024-03-11T18:29:45.134 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:45.142 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2024-03-11T18:29:45.143 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:45.152 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off
2024-03-11T18:29:45.153 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:45.161 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-11T18:29:45.170 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-03-11T18:29:45.174 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2024-03-11T18:29:49.166 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:49.174 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:49.180 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:49.276 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-11T18:29:49.282 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-03-11T18:29:49.290 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2024-03-11T18:29:53.278 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:53.285 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:53.292 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:53.388 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-11T18:29:53.393 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-11T18:29:53.400 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2024-03-11T18:29:53.489 INFO:teuthology.orchestra.console.smithi032:Power off completed
2024-03-11T18:29:53.494 INFO:teuthology.orchestra.console.smithi134:Power off completed
2024-03-11T18:29:53.590 INFO:teuthology.orchestra.console.smithi032:Power on
2024-03-11T18:29:53.591 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T18:29:53.599 INFO:teuthology.orchestra.console.smithi134:Power on
2024-03-11T18:29:53.599 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T18:29:53.620 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On
2024-03-11T18:29:53.621 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:53.628 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On
2024-03-11T18:29:53.628 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:53.641 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-11T18:29:53.651 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-11T18:29:57.405 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:57.514 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2024-03-11T18:29:57.615 INFO:teuthology.orchestra.console.smithi172:Power off completed
2024-03-11T18:29:57.642 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:57.652 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:57.716 INFO:teuthology.orchestra.console.smithi172:Power on
2024-03-11T18:29:57.716 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-03-11T18:29:57.737 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On
2024-03-11T18:29:57.738 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:29:57.751 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off
2024-03-11T18:29:57.759 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2024-03-11T18:29:57.761 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2024-03-11T18:30:01.756 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:30:01.763 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:30:01.769 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-03-11T18:30:01.866 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on
2024-03-11T18:30:01.872 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2024-03-11T18:30:01.877 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2024-03-11T18:30:01.967 INFO:teuthology.orchestra.console.smithi032:Power on completed
2024-03-11T18:30:01.972 INFO:teuthology.orchestra.console.smithi172:Power on completed
2024-03-11T18:30:01.978 INFO:teuthology.orchestra.console.smithi134:Power on completed
2024-03-11T18:30:02.068 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2024-03-11T18:30:02.073 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish
2024-03-11T18:30:02.078 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2024-03-11T18:32:32.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:32:35.934 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-11T18:32:41.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:32:45.022 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-11T18:32:47.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:32:47.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:32:51.006 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-11T18:32:51.007 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:32:51.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:32:54.078 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-11T18:32:57.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:32:57.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:00.062 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-11T18:33:00.063 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:33:00.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:03.134 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32
2024-03-11T18:33:06.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:06.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:09.118 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-11T18:33:09.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:09.154 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:33:15.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:15.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:18.178 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-11T18:33:18.210 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:33:24.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:24.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:27.266 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2024-03-11T18:33:27.267 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:33:33.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:33.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:36.350 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:33:42.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:33:45.438 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2024-03-11T18:33:51.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:09.153 WARNING:teuthology.provision.fog.smithi032:timed out
2024-03-11T18:34:15.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:15.393 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T18:34:15.393 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T18:34:15.653 INFO:teuthology.provision.fog.smithi032:Node is ready
2024-03-11T18:34:15.653 DEBUG:teuthology.orchestra.run.smithi032:> hostname
2024-03-11T18:34:15.674 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2024-03-11T18:34:15.674 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts
2024-03-11T18:34:15.735 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2024-03-11T18:34:15.735 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-11T18:34:15.861 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts
2024-03-11T18:34:15.896 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts
2024-03-11T18:34:15.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname
2024-03-11T18:34:16.056 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032
2024-03-11T18:34:16.138 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-11T18:34:16.201 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2024-03-11T18:34:16.201 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-11T18:34:16.202 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-11T18:34:16.203 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-11T18:34:16.203 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2024-03-11T18:34:16.205 DEBUG:teuthology.parallel:result is None
2024-03-11T18:34:33.290 WARNING:teuthology.provision.fog.smithi134:timed out
2024-03-11T18:34:39.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:39.566 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T18:34:39.566 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T18:34:39.798 INFO:teuthology.provision.fog.smithi134:Node is ready
2024-03-11T18:34:39.798 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2024-03-11T18:34:39.815 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2024-03-11T18:34:39.816 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2024-03-11T18:34:39.873 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2024-03-11T18:34:39.874 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-03-11T18:34:39.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2024-03-11T18:34:40.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2024-03-11T18:34:40.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2024-03-11T18:34:40.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2024-03-11T18:34:40.214 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)"
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6"
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2024-03-11T18:34:40.271 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-11T18:34:40.272 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-11T18:34:40.272 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2024-03-11T18:34:40.273 DEBUG:teuthology.parallel:result is None
2024-03-11T18:34:51.454 WARNING:teuthology.provision.fog.smithi172:timed out
2024-03-11T18:34:57.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:57.713 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-03-11T18:34:57.714 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-03-11T18:34:57.967 INFO:teuthology.provision.fog.smithi172:Node is ready
2024-03-11T18:34:57.967 DEBUG:teuthology.orchestra.run.smithi172:> hostname
2024-03-11T18:34:58.025 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com
2024-03-11T18:34:58.026 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts
2024-03-11T18:34:58.087 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172
2024-03-11T18:34:58.087 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2024-03-11T18:34:58.205 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts
2024-03-11T18:34:58.233 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts
2024-03-11T18:34:58.304 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname
2024-03-11T18:34:58.374 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2024-03-11T18:34:58.444 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2024-03-11T18:34:58.506 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux"
2024-03-11T18:34:58.506 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)"
2024-03-11T18:34:58.506 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel"
2024-03-11T18:34:58.506 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-11T18:34:58.507 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-11T18:34:58.508 INFO:teuthology.provision.fog.smithi172:Deploy complete!
2024-03-11T18:34:58.508 DEBUG:teuthology.parallel:result is None
2024-03-11T18:34:58.704 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2024-03-11T18:34:58.705 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T18:34:58.735 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2024-03-11T18:34:58.735 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T18:34:58.760 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com
2024-03-11T18:34:58.760 INFO:teuthology.lock.ops:New key found. Updating...
2024-03-11T18:34:58.779 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2024-03-11T18:34:58.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-11T18:34:58.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:58.858 DEBUG:teuthology.orchestra.run.smithi032:> true
2024-03-11T18:34:58.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com'
2024-03-11T18:34:58.960 DEBUG:teuthology.orchestra.run.smithi032:> uname -m
2024-03-11T18:34:59.021 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2024-03-11T18:34:59.021 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release
2024-03-11T18:34:59.082 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Red Hat Enterprise Linux"
2024-03-11T18:34:59.082 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8.6 (Ootpa)"
2024-03-11T18:34:59.082 INFO:teuthology.orchestra.run.smithi032.stdout:ID="rhel"
2024-03-11T18:34:59.082 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="fedora"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8.6"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.redhat.com/"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-11T18:34:59.083 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-11T18:34:59.084 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2024-03-11T18:34:59.110 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2024-03-11T18:34:59.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-03-11T18:34:59.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:59.186 DEBUG:teuthology.orchestra.run.smithi134:> true
2024-03-11T18:34:59.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2024-03-11T18:34:59.324 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2024-03-11T18:34:59.382 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2024-03-11T18:34:59.382 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T18:34:59.440 INFO:teuthology.orchestra.run.smithi134.stdout:
2024-03-11T18:34:59.441 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-11T18:34:59.441 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-11T18:34:59.441 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-11T18:34:59.441 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-11T18:34:59.441 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2024-03-11T18:34:59.460 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server
2024-03-11T18:34:59.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2024-03-11T18:34:59.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-03-11T18:34:59.535 DEBUG:teuthology.orchestra.run.smithi172:> true
2024-03-11T18:34:59.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com'
2024-03-11T18:34:59.604 DEBUG:teuthology.orchestra.run.smithi172:> uname -m
2024-03-11T18:34:59.666 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64
2024-03-11T18:34:59.666 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Red Hat Enterprise Linux"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8.6 (Ootpa)"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:ID="rhel"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="fedora"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8.6"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.redhat.com/"
2024-03-11T18:34:59.728 INFO:teuthology.orchestra.run.smithi172.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2024-03-11T18:34:59.729 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-03-11T18:34:59.729 INFO:teuthology.orchestra.run.smithi172.stdout:
2024-03-11T18:34:59.729 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2024-03-11T18:34:59.729 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2024-03-11T18:34:59.729 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2024-03-11T18:34:59.729 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2024-03-11T18:34:59.729 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2024-03-11T18:34:59.752 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:34:59.844 INFO:teuthology.dispatcher.supervisor:Running job 7591551
2024-03-11T18:34:59.844 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-11_18:14:19-rbd-wip-yuri3-testing-2024-02-28-0755-quincy-distro-default-smithi/7591551 --name yuriw-2024-03-11_18:14:19-rbd-wip-yuri3-testing-2024-02-28-0755-quincy-distro-default-smithi --description rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} conf/{disable-pool-app} features/readbalance msgr-failures/few objectstore/bluestore-stupid pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} -- /home/teuthworker/archive/yuriw-2024-03-11_18:14:19-rbd-wip-yuri3-testing-2024-02-28-0755-quincy-distro-default-smithi/7591551/orig.config.yaml
2024-03-11T18:34:59.847 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-11_18:14:19-rbd-wip-yuri3-testing-2024-02-28-0755-quincy-distro-default-smithi/7591551
2024-03-11T18:34:59.847 INFO:teuthology.dispatcher.supervisor:Job PID: 2820588
2024-03-11T18:34:59.847 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-03-11T18:36:59.948 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:39:00.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:41:00.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:43:00.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-03-11T18:43:00.447 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2024-03-11T18:43:00.569 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591246
2024-03-11T18:43:00.569 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591246
2024-03-11T18:43:00.569 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi172 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-03-11_14:02:35-fs-squid-distro-default-smithi/7591242