2024-02-14T14:35:58.989 INFO:root:teuthology version: 0.0.1.dev258+g9e44c16 2024-02-14T14:35:58.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:35:59.146 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f84ce5f7c10>, signals=[15]) 2024-02-14T14:35:59.147 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2024-02-14T14:35:59.147 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T14:35:59.147 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-02-14T14:35:59.172 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2024-02-14T14:35:59.172 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T14:35:59.172 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-02-14T14:35:59.196 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2024-02-14T14:35:59.196 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2024-02-14T14:35:59.196 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-02-14T14:35:59.297 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10) 2024-02-14T14:35:59.313 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_9.stream (ID 10) 2024-02-14T14:35:59.335 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_9.stream (ID 10) 2024-02-14T14:35:59.338 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream 2024-02-14T14:35:59.351 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 9.stream 2024-02-14T14:35:59.379 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 9.stream 2024-02-14T14:35:59.623 INFO:teuthology.orchestra.console.smithi050:Power off 2024-02-14T14:35:59.624 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T14:35:59.635 INFO:teuthology.orchestra.console.smithi017:Power off 2024-02-14T14:35:59.636 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T14:35:59.647 INFO:teuthology.orchestra.console.smithi076:Power off 2024-02-14T14:35:59.647 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-14T14:35:59.654 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off 2024-02-14T14:35:59.655 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:35:59.661 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-02-14T14:35:59.661 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:35:59.669 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-02-14T14:35:59.669 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:35:59.677 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-02-14T14:35:59.684 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-02-14T14:35:59.689 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-14T14:36:03.682 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:03.689 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:03.695 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:03.791 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-02-14T14:36:03.797 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-02-14T14:36:03.804 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-14T14:36:07.796 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:07.802 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:07.809 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:07.905 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-02-14T14:36:07.911 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-02-14T14:36:07.917 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-14T14:36:11.910 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:11.916 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:11.921 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:12.018 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-02-14T14:36:12.023 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-02-14T14:36:12.030 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-02-14T14:36:12.119 INFO:teuthology.orchestra.console.smithi050:Power off completed 2024-02-14T14:36:12.123 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-02-14T14:36:12.131 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-02-14T14:36:12.220 INFO:teuthology.orchestra.console.smithi050:Power on 2024-02-14T14:36:12.220 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T14:36:12.226 INFO:teuthology.orchestra.console.smithi017:Power on 2024-02-14T14:36:12.227 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T14:36:12.232 INFO:teuthology.orchestra.console.smithi076:Power on 2024-02-14T14:36:12.232 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-14T14:36:12.239 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On 2024-02-14T14:36:12.240 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:12.248 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2024-02-14T14:36:12.248 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:12.256 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-02-14T14:36:12.256 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:12.264 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off 2024-02-14T14:36:12.268 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-02-14T14:36:12.277 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-02-14T14:36:16.269 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:16.276 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:16.282 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:16.378 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on 2024-02-14T14:36:16.384 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-02-14T14:36:16.391 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-02-14T14:36:16.480 INFO:teuthology.orchestra.console.smithi050:Power on completed 2024-02-14T14:36:16.485 INFO:teuthology.orchestra.console.smithi017:Power on completed 2024-02-14T14:36:16.581 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2024-02-14T14:36:16.586 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2024-02-14T14:36:20.396 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-14T14:36:20.504 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-02-14T14:36:20.605 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-02-14T14:36:20.706 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2024-02-14T14:38:47.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:38:47.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:06.045 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-02-14T14:39:06.045 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-02-14T14:39:06.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:12.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:12.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:15.132 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-02-14T14:39:15.132 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-02-14T14:39:21.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:21.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:24.220 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50 2024-02-14T14:39:24.221 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-02-14T14:39:25.244 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:39:30.227 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:30.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:31.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:34.300 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:39:40.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:43.388 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:39:49.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:39:52.477 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:39:58.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:40:01.532 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:40:07.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:40:10.620 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:40:16.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:40:19.708 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-02-14T14:40:25.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:40:30.234 WARNING:teuthology.provision.fog.smithi050:timed out 2024-02-14T14:40:30.234 WARNING:teuthology.provision.fog.smithi017:timed out 2024-02-14T14:40:36.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:40:36.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:40:36.555 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T14:40:36.556 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T14:40:36.573 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T14:40:36.573 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T14:40:36.844 INFO:teuthology.provision.fog.smithi017:Node is ready 2024-02-14T14:40:36.844 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2024-02-14T14:40:36.859 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2024-02-14T14:40:36.859 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2024-02-14T14:40:36.895 INFO:teuthology.provision.fog.smithi050:Node is ready 2024-02-14T14:40:36.896 DEBUG:teuthology.orchestra.run.smithi050:> hostname 2024-02-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2024-02-14T14:40:36.911 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts 2024-02-14T14:40:36.915 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2024-02-14T14:40:36.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-02-14T14:40:36.967 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2024-02-14T14:40:36.967 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2024-02-14T14:40:37.024 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2024-02-14T14:40:37.055 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2024-02-14T14:40:37.075 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts 2024-02-14T14:40:37.106 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts 2024-02-14T14:40:37.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2024-02-14T14:40:37.178 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname 2024-02-14T14:40:37.197 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-02-14T14:40:37.249 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050 2024-02-14T14:40:37.267 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-02-14T14:40:37.319 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-02-14T14:40:37.322 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T14:40:37.323 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T14:40:37.324 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2024-02-14T14:40:37.325 DEBUG:teuthology.parallel:result is None 2024-02-14T14:40:37.374 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T14:40:37.375 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T14:40:37.375 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2024-02-14T14:40:37.376 DEBUG:teuthology.parallel:result is None 2024-02-14T14:41:25.766 WARNING:teuthology.provision.fog.smithi076:timed out 2024-02-14T14:41:31.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:41:32.015 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-14T14:41:32.015 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-14T14:41:32.336 INFO:teuthology.provision.fog.smithi076:Node is ready 2024-02-14T14:41:32.336 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2024-02-14T14:41:32.351 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2024-02-14T14:41:32.351 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2024-02-14T14:41:32.407 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2024-02-14T14:41:32.407 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-02-14T14:41:32.508 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2024-02-14T14:41:32.535 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2024-02-14T14:41:32.602 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2024-02-14T14:41:32.669 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-02-14T14:41:32.736 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-02-14T14:41:32.790 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-02-14T14:41:32.790 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-02-14T14:41:32.790 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-02-14T14:41:32.790 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-02-14T14:41:32.790 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-02-14T14:41:32.790 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T14:41:32.791 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T14:41:32.791 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2024-02-14T14:41:32.792 DEBUG:teuthology.parallel:result is None 2024-02-14T14:41:33.004 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2024-02-14T14:41:33.005 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T14:41:33.029 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2024-02-14T14:41:33.029 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T14:41:33.053 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2024-02-14T14:41:33.053 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-14T14:41:33.071 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2024-02-14T14:41:33.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-02-14T14:41:33.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:41:33.174 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-02-14T14:41:33.354 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-02-14T14:41:33.354 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-02-14T14:41:33.409 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-02-14T14:41:33.410 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T14:41:33.465 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T14:41:33.466 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-02-14T14:41:33.487 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2024-02-14T14:41:33.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-02-14T14:41:33.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:41:33.590 DEBUG:teuthology.orchestra.run.smithi050:> true 2024-02-14T14:41:33.770 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com' 2024-02-14T14:41:33.770 DEBUG:teuthology.orchestra.run.smithi050:> uname -m 2024-02-14T14:41:33.826 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2024-02-14T14:41:33.827 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release 2024-02-14T14:41:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2024-02-14T14:41:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="9" 2024-02-14T14:41:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2024-02-14T14:41:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2024-02-14T14:41:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="9" 2024-02-14T14:41:33.882 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el9" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:LOGO="fedora-logo-icon" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T14:41:33.883 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T14:41:33.884 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2024-02-14T14:41:33.904 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2024-02-14T14:41:33.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-02-14T14:41:33.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-14T14:41:33.991 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-02-14T14:41:34.060 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-02-14T14:41:34.061 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-02-14T14:41:34.117 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-02-14T14:41:34.117 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-02-14T14:41:34.172 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-02-14T14:41:34.172 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="9" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="9" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el9" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:LOGO="fedora-logo-icon" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-14T14:41:34.173 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-14T14:41:34.174 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-02-14T14:41:34.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:41:34.289 INFO:teuthology.dispatcher.supervisor:Running job 7559621 2024-02-14T14:41:34.289 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9e44c16382dfc4c612f7437cbb344c76223137cc/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559621 --name vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559621/orig.config.yaml 2024-02-14T14:41:34.291 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-14_05:24:17-fs-wip-vshankar-testing-20240206.051942-testing-default-smithi/7559621 2024-02-14T14:41:34.291 INFO:teuthology.dispatcher.supervisor:Job PID: 1355003 2024-02-14T14:41:34.292 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-14T14:43:34.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:45:34.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:47:34.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:49:35.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:51:35.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:53:35.358 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:55:35.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:57:35.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T14:59:35.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:01:36.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:03:36.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:05:36.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:07:36.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:09:36.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:11:36.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:13:36.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:15:37.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:17:37.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:19:37.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:21:37.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:23:37.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:25:37.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:27:38.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:29:38.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:31:38.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:33:38.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:35:38.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-14T15:35:38.917 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1