2024-03-23T13:33:12.980 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-23T13:33:12.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:33:13.138 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f03e17a1c10>, signals=[15]) 2024-03-23T13:33:13.138 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2024-03-23T13:33:13.138 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2024-03-23T13:33:13.138 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-23T13:33:13.161 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-03-23T13:33:13.161 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-03-23T13:33:13.161 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-03-23T13:33:13.185 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2024-03-23T13:33:13.185 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2024-03-23T13:33:13.186 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-23T13:33:13.261 DEBUG:teuthology.provision.fog.smithi005:Requesting image smithi_centos_9.stream (ID 10) 2024-03-23T13:33:13.301 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 9.stream 2024-03-23T13:33:13.306 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-03-23T13:33:13.336 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2024-03-23T13:33:13.391 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2024-03-23T13:33:13.533 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-03-23T13:33:13.826 INFO:teuthology.orchestra.console.smithi005:Power off 2024-03-23T13:33:13.827 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T13:33:13.848 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-03-23T13:33:13.848 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:13.874 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-23T13:33:13.949 INFO:teuthology.orchestra.console.smithi195:Power off 2024-03-23T13:33:13.949 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T13:33:13.973 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-03-23T13:33:13.973 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:13.980 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-03-23T13:33:13.993 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-23T13:33:14.048 INFO:teuthology.orchestra.console.smithi115:Power off 2024-03-23T13:33:14.048 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-23T13:33:14.067 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-03-23T13:33:14.068 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:14.080 INFO:teuthology.orchestra.console.smithi005:Power on 2024-03-23T13:33:14.081 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-23T13:33:14.088 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-23T13:33:14.094 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-03-23T13:33:14.100 DEBUG:teuthology.orchestra.console.smithi005:power on output: Chassis Power Control: Up/On 2024-03-23T13:33:14.100 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:14.121 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-23T13:33:14.190 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-03-23T13:33:14.194 INFO:teuthology.orchestra.console.smithi195:Power on 2024-03-23T13:33:14.194 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-23T13:33:14.215 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2024-03-23T13:33:14.215 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:14.236 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-23T13:33:14.290 INFO:teuthology.orchestra.console.smithi115:Power on 2024-03-23T13:33:14.291 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-23T13:33:14.311 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-03-23T13:33:14.311 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:14.331 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-23T13:33:18.126 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:18.235 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-03-23T13:33:18.237 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:18.332 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:18.346 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-23T13:33:18.441 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-23T13:33:22.238 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:22.347 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-03-23T13:33:22.347 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:22.442 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-23T13:33:22.450 INFO:teuthology.orchestra.console.smithi005:Power on completed 2024-03-23T13:33:22.456 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-03-23T13:33:22.550 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2024-03-23T13:33:22.554 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-03-23T13:33:22.557 INFO:teuthology.orchestra.console.smithi195:Power on completed 2024-03-23T13:33:22.655 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-03-23T13:33:22.658 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2024-03-23T13:33:22.756 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-03-23T13:38:43.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:38:43.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:38:46.142 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-23T13:38:46.143 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:38:52.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:38:52.149 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:38:55.198 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-23T13:38:55.199 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:38:58.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:01.182 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-23T13:39:01.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:01.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:04.254 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-23T13:39:04.255 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:39:07.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:10.238 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-23T13:39:10.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:10.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:13.310 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-23T13:39:13.311 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:39:16.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:19.295 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-23T13:39:19.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:19.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:22.366 WARNING:teuthology.provision.fog.smithi005:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-03-23T13:39:22.367 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:39:25.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:28.350 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-23T13:39:28.368 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:28.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:31.426 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:39:34.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:37.406 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-23T13:39:37.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:40.478 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-23T13:39:43.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:46.462 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-23T13:39:46.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:39:52.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:40:28.407 WARNING:teuthology.provision.fog.smithi005:timed out 2024-03-23T13:40:34.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:40:34.653 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-23T13:40:34.654 DEBUG:teuthology.orchestra.run.smithi005:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-23T13:40:34.994 INFO:teuthology.provision.fog.smithi005:Node is ready 2024-03-23T13:40:34.994 DEBUG:teuthology.orchestra.run.smithi005:> hostname 2024-03-23T13:40:35.009 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2024-03-23T13:40:35.010 DEBUG:teuthology.orchestra.run.smithi005:> grep smithi005.front.sepia.ceph.com /etc/hosts 2024-03-23T13:40:35.066 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2024-03-23T13:40:35.066 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-03-23T13:40:35.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hosts 2024-03-23T13:40:35.221 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/172.21.15.5/172.21.15.5/g' /etc/hosts 2024-03-23T13:40:35.294 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i -e 's/smithi005.front.sepia.ceph.com/smithi005/g' /etc/hostname 2024-03-23T13:40:35.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname smithi005 2024-03-23T13:40:35.439 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-23T13:40:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-03-23T13:40:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-03-23T13:40:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-03-23T13:40:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-03-23T13:40:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-03-23T13:40:35.495 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T13:40:35.496 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T13:40:35.497 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2024-03-23T13:40:35.498 DEBUG:teuthology.parallel:result is None 2024-03-23T13:40:46.491 WARNING:teuthology.provision.fog.smithi115:timed out 2024-03-23T13:40:52.475 WARNING:teuthology.provision.fog.smithi195:timed out 2024-03-23T13:40:52.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:40:52.770 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-23T13:40:52.770 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-23T13:40:53.111 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-03-23T13:40:53.111 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-03-23T13:40:53.125 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-03-23T13:40:53.126 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-03-23T13:40:53.181 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-03-23T13:40:53.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-03-23T13:40:53.322 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-03-23T13:40:53.350 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-03-23T13:40:53.417 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-03-23T13:40:53.483 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-03-23T13:40:53.550 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-03-23T13:40:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-03-23T13:40:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-03-23T13:40:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-03-23T13:40:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-03-23T13:40:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-03-23T13:40:53.604 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T13:40:53.605 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T13:40:53.605 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-03-23T13:40:53.606 DEBUG:teuthology.parallel:result is None 2024-03-23T13:40:58.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:40:58.792 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-23T13:40:58.793 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-23T13:40:59.108 INFO:teuthology.provision.fog.smithi195:Node is ready 2024-03-23T13:40:59.108 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2024-03-23T13:40:59.123 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2024-03-23T13:40:59.124 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2024-03-23T13:40:59.176 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2024-03-23T13:40:59.177 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-03-23T13:40:59.276 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2024-03-23T13:40:59.304 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2024-03-23T13:40:59.370 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2024-03-23T13:40:59.435 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-03-23T13:40:59.502 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-23T13:40:59.554 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T13:40:59.555 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T13:40:59.556 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2024-03-23T13:40:59.556 DEBUG:teuthology.parallel:result is None 2024-03-23T13:40:59.773 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2024-03-23T13:40:59.773 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-23T13:40:59.803 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-03-23T13:40:59.803 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-23T13:40:59.828 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2024-03-23T13:40:59.828 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-23T13:40:59.854 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2024-03-23T13:40:59.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-23T13:40:59.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:40:59.959 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-03-23T13:41:00.145 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-03-23T13:41:00.145 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-03-23T13:41:00.199 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-03-23T13:41:00.200 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-03-23T13:41:00.254 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-03-23T13:41:00.254 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-03-23T13:41:00.254 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T13:41:00.255 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T13:41:00.257 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-03-23T13:41:00.286 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-03-23T13:41:00.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-03-23T13:41:00.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:41:00.377 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-03-23T13:41:00.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-03-23T13:41:00.404 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-03-23T13:41:00.463 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-03-23T13:41:00.464 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-03-23T13:41:00.523 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T13:41:00.524 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T13:41:00.525 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-03-23T13:41:00.553 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2024-03-23T13:41:00.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-23T13:41:00.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-23T13:41:00.642 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-23T13:41:00.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-23T13:41:00.712 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-03-23T13:41:00.766 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-03-23T13:41:00.766 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-23T13:41:00.819 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-23T13:41:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-23T13:41:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-23T13:41:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-23T13:41:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-23T13:41:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-23T13:41:00.820 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-23T13:41:00.820 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-23T13:41:00.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:41:00.944 INFO:teuthology.dispatcher.supervisor:Running job 7618341 2024-03-23T13:41:00.944 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-23_09:56:53-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7618341 --name pdonnell-2024-03-23_09:56:53-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2024-03-23_09:56:53-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7618341/orig.config.yaml 2024-03-23T13:41:00.947 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2024-03-23_09:56:53-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7618341 2024-03-23T13:41:00.947 INFO:teuthology.dispatcher.supervisor:Job PID: 73805 2024-03-23T13:41:00.947 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-23T13:43:01.048 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:45:01.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:47:01.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:49:01.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:51:01.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:53:01.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:55:02.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:57:02.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T13:59:02.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:01:02.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:03:02.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:05:03.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:07:03.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:09:03.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:11:03.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:13:03.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:15:03.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:17:04.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:19:04.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:21:04.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-23T14:21:04.462 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1