2024-04-17T22:23:03.997 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-17T22:23:03.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:23:04.220 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f91ab732c10>, signals=[15]) 2024-04-17T22:23:04.220 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2024-04-17T22:23:04.220 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T22:23:04.221 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-17T22:23:04.243 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2024-04-17T22:23:04.243 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T22:23:04.243 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-17T22:23:04.267 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2024-04-17T22:23:04.268 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T22:23:04.268 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-04-17T22:23:04.360 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T22:23:04.377 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T22:23:04.402 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T22:23:04.422 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 9.stream 2024-04-17T22:23:04.426 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2024-04-17T22:23:04.446 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream 2024-04-17T22:23:04.694 INFO:teuthology.orchestra.console.smithi203:Power off 2024-04-17T22:23:04.694 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T22:23:04.714 INFO:teuthology.orchestra.console.smithi156:Power off 2024-04-17T22:23:04.714 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T22:23:04.732 INFO:teuthology.orchestra.console.smithi081:Power off 2024-04-17T22:23:04.732 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T22:23:04.739 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2024-04-17T22:23:04.739 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:04.747 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-04-17T22:23:04.747 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:04.758 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-04-17T22:23:04.758 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:04.770 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-17T22:23:04.775 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-04-17T22:23:04.787 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-17T22:23:04.871 INFO:teuthology.orchestra.console.smithi156:Power off completed 2024-04-17T22:23:04.876 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-04-17T22:23:04.889 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-04-17T22:23:04.972 INFO:teuthology.orchestra.console.smithi156:Power on 2024-04-17T22:23:04.972 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T22:23:04.981 INFO:teuthology.orchestra.console.smithi203:Power on 2024-04-17T22:23:04.982 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T22:23:04.989 INFO:teuthology.orchestra.console.smithi081:Power on 2024-04-17T22:23:04.990 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T22:23:04.999 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2024-04-17T22:23:05.000 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:05.008 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2024-04-17T22:23:05.008 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:05.016 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2024-04-17T22:23:05.016 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:05.025 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-17T22:23:05.028 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-04-17T22:23:05.037 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-17T22:23:09.030 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:09.039 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:09.045 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:09.142 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2024-04-17T22:23:09.148 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-04-17T22:23:09.154 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-04-17T22:23:13.146 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:13.153 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:13.159 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T22:23:13.256 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2024-04-17T22:23:13.261 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-04-17T22:23:13.268 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-04-17T22:23:13.357 INFO:teuthology.orchestra.console.smithi156:Power on completed 2024-04-17T22:23:13.361 INFO:teuthology.orchestra.console.smithi203:Power on completed 2024-04-17T22:23:13.369 INFO:teuthology.orchestra.console.smithi081:Power on completed 2024-04-17T22:23:13.458 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2024-04-17T22:23:13.462 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2024-04-17T22:23:13.470 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2024-04-17T22:25:45.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:25:48.158 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-17T22:25:54.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:25:57.214 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-17T22:26:03.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:06.270 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-17T22:26:12.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:15.326 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-17T22:26:21.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:24.382 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-17T22:26:30.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:30.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:33.438 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-04-17T22:26:33.538 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-17T22:26:39.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:39.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:42.590 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-17T22:26:48.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:26:51.646 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-17T22:26:57.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:00.734 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-17T22:27:06.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:09.826 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-17T22:27:15.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:15.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:18.782 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:27:18.878 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2024-04-17T22:27:24.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:24.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:27.870 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:27:33.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:36.958 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:27:39.450 WARNING:teuthology.provision.fog.smithi081:timed out 2024-04-17T22:27:42.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:45.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:45.935 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T22:27:45.935 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T22:27:46.014 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:27:46.262 INFO:teuthology.provision.fog.smithi081:Node is ready 2024-04-17T22:27:46.262 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2024-04-17T22:27:46.277 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2024-04-17T22:27:46.277 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2024-04-17T22:27:46.332 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2024-04-17T22:27:46.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-04-17T22:27:46.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2024-04-17T22:27:46.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2024-04-17T22:27:46.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2024-04-17T22:27:46.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2024-04-17T22:27:46.697 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-17T22:27:46.751 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-04-17T22:27:46.751 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-04-17T22:27:46.751 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:27:46.752 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:27:46.753 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2024-04-17T22:27:46.755 DEBUG:teuthology.parallel:result is None 2024-04-17T22:27:52.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:27:55.070 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:28:01.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:28:04.130 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:28:10.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:28:13.214 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-04-17T22:28:19.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:28:24.886 WARNING:teuthology.provision.fog.smithi156:timed out 2024-04-17T22:28:30.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:28:31.462 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T22:28:31.462 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T22:28:31.792 INFO:teuthology.provision.fog.smithi156:Node is ready 2024-04-17T22:28:31.792 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2024-04-17T22:28:31.806 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2024-04-17T22:28:31.806 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2024-04-17T22:28:31.861 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2024-04-17T22:28:31.862 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-04-17T22:28:31.979 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2024-04-17T22:28:32.008 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2024-04-17T22:28:32.075 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2024-04-17T22:28:32.142 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2024-04-17T22:28:32.208 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-17T22:28:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-04-17T22:28:32.262 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:28:32.263 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:28:32.264 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2024-04-17T22:28:32.264 DEBUG:teuthology.parallel:result is None 2024-04-17T22:29:19.263 WARNING:teuthology.provision.fog.smithi203:timed out 2024-04-17T22:29:25.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:29:25.507 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T22:29:25.507 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T22:29:25.870 INFO:teuthology.provision.fog.smithi203:Node is ready 2024-04-17T22:29:25.870 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2024-04-17T22:29:25.885 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com 2024-04-17T22:29:25.885 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts 2024-04-17T22:29:25.941 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203 2024-04-17T22:29:25.941 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2024-04-17T22:29:26.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts 2024-04-17T22:29:26.073 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts 2024-04-17T22:29:26.141 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname 2024-04-17T22:29:26.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2024-04-17T22:29:26.276 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-04-17T22:29:26.331 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-04-17T22:29:26.331 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-04-17T22:29:26.331 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-04-17T22:29:26.331 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:29:26.331 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:29:26.332 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:29:26.332 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2024-04-17T22:29:26.333 DEBUG:teuthology.parallel:result is None 2024-04-17T22:29:26.544 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2024-04-17T22:29:26.544 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T22:29:26.569 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2024-04-17T22:29:26.569 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T22:29:26.585 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2024-04-17T22:29:26.586 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T22:29:26.612 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2024-04-17T22:29:26.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-17T22:29:26.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:29:26.702 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-04-17T22:29:26.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-04-17T22:29:26.868 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-04-17T22:29:26.923 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-04-17T22:29:26.923 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-04-17T22:29:26.977 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:29:26.978 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:29:26.979 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:29:26.979 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-04-17T22:29:27.019 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2024-04-17T22:29:27.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-17T22:29:27.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:29:27.107 DEBUG:teuthology.orchestra.run.smithi156:> true 2024-04-17T22:29:27.272 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2024-04-17T22:29:27.272 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2024-04-17T22:29:27.327 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2024-04-17T22:29:27.327 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:29:27.382 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:29:27.383 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:29:27.383 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:29:27.383 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:29:27.383 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:29:27.383 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2024-04-17T22:29:27.411 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2024-04-17T22:29:27.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-17T22:29:27.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T22:29:27.496 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-04-17T22:29:27.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-04-17T22:29:27.567 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-04-17T22:29:27.623 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-04-17T22:29:27.624 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T22:29:27.681 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-04-17T22:29:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T22:29:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T22:29:27.682 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T22:29:27.682 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-04-17T22:29:27.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:29:27.812 INFO:teuthology.dispatcher.supervisor:Running job 7661166 2024-04-17T22:29:27.813 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661166 --name teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661166/orig.config.yaml 2024-04-17T22:29:27.816 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_21:24:02-fs-squid-distro-default-smithi/7661166 2024-04-17T22:29:27.816 INFO:teuthology.dispatcher.supervisor:Job PID: 3494986 2024-04-17T22:29:27.816 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T22:31:27.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:33:28.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:35:28.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:37:28.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T22:37:28.496 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1