2024-03-31T04:11:15.079 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-31T04:11:15.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:11:15.253 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f30fd52fc10>, signals=[15]) 2024-03-31T04:11:15.254 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2024-03-31T04:11:15.254 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T04:11:15.254 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-03-31T04:11:15.271 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-03-31T04:11:15.271 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T04:11:15.271 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-03-31T04:11:15.296 INFO:teuthology.lock.ops:Start node 'smithi195.front.sepia.ceph.com' reimaging 2024-03-31T04:11:15.296 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: reset os type and version on server 2024-03-31T04:11:15.296 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-31T04:11:15.376 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T04:11:15.398 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T04:11:15.422 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream 2024-03-31T04:11:15.427 DEBUG:teuthology.provision.fog.smithi195:Requesting image smithi_centos_9.stream (ID 10) 2024-03-31T04:11:15.446 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-03-31T04:11:15.463 INFO:teuthology.provision.fog.smithi195:Scheduling deploy of centos 9.stream 2024-03-31T04:11:15.666 INFO:teuthology.orchestra.console.smithi107:Power off 2024-03-31T04:11:15.666 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T04:11:15.679 INFO:teuthology.orchestra.console.smithi115:Power off 2024-03-31T04:11:15.679 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T04:11:15.687 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-03-31T04:11:15.688 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:15.700 INFO:teuthology.orchestra.console.smithi195:Power off 2024-03-31T04:11:15.700 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-31T04:11:15.708 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-03-31T04:11:15.708 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:15.715 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-03-31T04:11:15.719 DEBUG:teuthology.orchestra.console.smithi195:power off output: Chassis Power Control: Down/Off 2024-03-31T04:11:15.720 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:15.727 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-31T04:11:15.739 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-31T04:11:15.816 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-03-31T04:11:15.827 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-03-31T04:11:15.840 INFO:teuthology.orchestra.console.smithi195:Power off completed 2024-03-31T04:11:15.917 INFO:teuthology.orchestra.console.smithi107:Power on 2024-03-31T04:11:15.917 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T04:11:15.928 INFO:teuthology.orchestra.console.smithi115:Power on 2024-03-31T04:11:15.928 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T04:11:15.936 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2024-03-31T04:11:15.937 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:15.942 INFO:teuthology.orchestra.console.smithi195:Power on 2024-03-31T04:11:15.942 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-31T04:11:15.950 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-03-31T04:11:15.950 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:15.957 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-03-31T04:11:15.962 DEBUG:teuthology.orchestra.console.smithi195:power on output: Chassis Power Control: Up/On 2024-03-31T04:11:15.962 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:15.968 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-31T04:11:15.983 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is off 2024-03-31T04:11:19.961 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:19.969 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:19.984 DEBUG:teuthology.orchestra.console.smithi195:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:20.070 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-03-31T04:11:20.077 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-03-31T04:11:20.092 DEBUG:teuthology.orchestra.console.smithi195:check power output: Chassis Power is on 2024-03-31T04:11:20.171 INFO:teuthology.orchestra.console.smithi107:Power on completed 2024-03-31T04:11:20.193 INFO:teuthology.orchestra.console.smithi195:Power on completed 2024-03-31T04:11:20.272 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2024-03-31T04:11:20.293 INFO:teuthology.provision.fog.smithi195:Waiting for deploy to finish 2024-03-31T04:11:24.082 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-31T04:11:24.191 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-03-31T04:11:24.291 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-03-31T04:11:24.392 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-03-31T04:13:51.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:13:54.078 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-31T04:14:00.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:03.166 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-31T04:14:06.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:09.150 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-31T04:14:09.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:10.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:12.222 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-31T04:14:13.214 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:14:15.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:18.206 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-31T04:14:18.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:19.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:21.278 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-31T04:14:22.270 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:14:24.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:27.262 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-31T04:14:27.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:28.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:30.334 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-31T04:14:31.326 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:14:33.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:36.318 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-31T04:14:36.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:37.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:39.390 WARNING:teuthology.provision.fog.smithi195:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-31T04:14:40.382 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:14:42.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:45.374 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-31T04:14:45.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:46.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:49.438 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:14:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:54.430 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-31T04:14:55.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:14:58.494 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:15:00.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:15:04.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:15:07.582 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:15:13.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:15:16.638 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-03-31T04:15:22.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:15:45.414 WARNING:teuthology.provision.fog.smithi195:timed out 2024-03-31T04:15:51.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:15:51.627 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T04:15:51.627 DEBUG:teuthology.orchestra.run.smithi195:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T04:15:51.942 INFO:teuthology.provision.fog.smithi195:Node is ready 2024-03-31T04:15:51.943 DEBUG:teuthology.orchestra.run.smithi195:> hostname 2024-03-31T04:15:51.957 INFO:teuthology.orchestra.run.smithi195.stdout:smithi195.front.sepia.ceph.com 2024-03-31T04:15:51.957 DEBUG:teuthology.orchestra.run.smithi195:> grep smithi195.front.sepia.ceph.com /etc/hosts 2024-03-31T04:15:52.012 INFO:teuthology.orchestra.run.smithi195.stdout:172.21.15.195 smithi195.front.sepia.ceph.com smithi195 2024-03-31T04:15:52.013 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-03-31T04:15:52.118 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hosts 2024-03-31T04:15:52.146 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/172.21.15.195/172.21.15.195/g' /etc/hosts 2024-03-31T04:15:52.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i -e 's/smithi195.front.sepia.ceph.com/smithi195/g' /etc/hostname 2024-03-31T04:15:52.282 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname smithi195 2024-03-31T04:15:52.348 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-31T04:15:52.402 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-31T04:15:52.402 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-31T04:15:52.402 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-31T04:15:52.402 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-31T04:15:52.402 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T04:15:52.403 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T04:15:52.404 INFO:teuthology.provision.fog.smithi195:Deploy complete! 2024-03-31T04:15:52.405 DEBUG:teuthology.parallel:result is None 2024-03-31T04:16:00.443 WARNING:teuthology.provision.fog.smithi107:timed out 2024-03-31T04:16:06.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:16:06.770 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T04:16:06.770 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T04:16:07.087 INFO:teuthology.provision.fog.smithi107:Node is ready 2024-03-31T04:16:07.088 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2024-03-31T04:16:07.102 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2024-03-31T04:16:07.102 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2024-03-31T04:16:07.157 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2024-03-31T04:16:07.157 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-03-31T04:16:07.266 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2024-03-31T04:16:07.294 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2024-03-31T04:16:07.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2024-03-31T04:16:07.428 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-03-31T04:16:07.495 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-03-31T04:16:07.550 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-03-31T04:16:07.550 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-03-31T04:16:07.550 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-03-31T04:16:07.550 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T04:16:07.551 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T04:16:07.551 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2024-03-31T04:16:07.552 DEBUG:teuthology.parallel:result is None 2024-03-31T04:16:22.662 WARNING:teuthology.provision.fog.smithi115:timed out 2024-03-31T04:16:28.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:16:28.890 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-31T04:16:28.891 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-31T04:16:29.224 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-03-31T04:16:29.224 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-03-31T04:16:29.238 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-03-31T04:16:29.239 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-03-31T04:16:29.294 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-03-31T04:16:29.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-03-31T04:16:29.417 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-03-31T04:16:29.446 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-03-31T04:16:29.513 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-03-31T04:16:29.580 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-03-31T04:16:29.646 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-03-31T04:16:29.700 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T04:16:29.701 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T04:16:29.702 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-03-31T04:16:29.702 DEBUG:teuthology.parallel:result is None 2024-03-31T04:16:29.911 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2024-03-31T04:16:29.911 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T04:16:29.930 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-03-31T04:16:29.930 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T04:16:29.946 INFO:teuthology.lock.ops:Checking smithi195.front.sepia.ceph.com 2024-03-31T04:16:29.946 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-31T04:16:29.964 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2024-03-31T04:16:29.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-31T04:16:29.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:16:30.053 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-03-31T04:16:30.220 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-31T04:16:30.220 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-03-31T04:16:30.275 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-03-31T04:16:30.276 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-03-31T04:16:30.330 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T04:16:30.331 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T04:16:30.331 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-03-31T04:16:30.355 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-03-31T04:16:30.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-03-31T04:16:30.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:16:30.439 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-03-31T04:16:30.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-03-31T04:16:30.505 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-03-31T04:16:30.561 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-03-31T04:16:30.561 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-03-31T04:16:30.617 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T04:16:30.618 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-03-31T04:16:30.618 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T04:16:30.618 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T04:16:30.618 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T04:16:30.618 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-03-31T04:16:30.638 INFO:teuthology.lock.ops:Updating [smithi195.front.sepia.ceph.com]: set os type and version on server 2024-03-31T04:16:30.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-31T04:16:30.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-31T04:16:30.725 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-31T04:16:30.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-31T04:16:30.896 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-03-31T04:16:30.951 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-03-31T04:16:30.951 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-31T04:16:31.006 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-31T04:16:31.006 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-31T04:16:31.006 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-31T04:16:31.006 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-31T04:16:31.006 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-31T04:16:31.006 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-31T04:16:31.007 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-31T04:16:31.007 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-31T04:16:31.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:16:31.132 INFO:teuthology.dispatcher.supervisor:Running job 7631073 2024-03-31T04:16:31.133 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631073 --name mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/suites/iogen}} -- /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631073/orig.config.yaml 2024-03-31T04:16:31.136 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-03-30_04:03:11-fs-wip-mchangir-testing-main-20240318.032620-testing-default-smithi/7631073 2024-03-31T04:16:31.136 INFO:teuthology.dispatcher.supervisor:Job PID: 2080665 2024-03-31T04:16:31.136 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-31T04:18:31.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:20:31.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:22:31.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:24:31.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:26:31.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:28:32.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:30:32.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:32:32.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:34:32.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:36:32.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:38:32.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:40:33.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:42:33.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:44:33.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:46:33.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:48:33.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:50:33.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:52:34.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:54:34.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:56:34.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T04:58:34.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:00:34.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:02:34.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:04:35.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:06:35.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-31T05:06:35.397 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1