2024-04-01T14:37:25.173 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T14:37:25.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:37:25.335 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6790e0dc10>, signals=[15]) 2024-04-01T14:37:25.335 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2024-04-01T14:37:25.335 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T14:37:25.335 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-01T14:37:25.356 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-04-01T14:37:25.356 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T14:37:25.356 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-01T14:37:25.380 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-04-01T14:37:25.380 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T14:37:25.380 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-01T14:37:25.488 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T14:37:25.509 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T14:37:25.512 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10) 2024-04-01T14:37:25.538 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 9.stream 2024-04-01T14:37:25.555 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 9.stream 2024-04-01T14:37:25.563 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream 2024-04-01T14:37:25.760 INFO:teuthology.orchestra.console.smithi138:Power off 2024-04-01T14:37:25.761 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T14:37:25.785 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-04-01T14:37:25.785 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:25.797 INFO:teuthology.orchestra.console.smithi175:Power off 2024-04-01T14:37:25.797 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T14:37:25.809 INFO:teuthology.orchestra.console.smithi142:Power off 2024-04-01T14:37:25.810 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T14:37:25.817 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-04-01T14:37:25.818 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-04-01T14:37:25.818 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:25.832 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-04-01T14:37:25.832 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:25.841 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-01T14:37:25.855 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T14:37:25.942 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-04-01T14:37:26.043 INFO:teuthology.orchestra.console.smithi175:Power on 2024-04-01T14:37:26.043 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T14:37:26.064 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-04-01T14:37:26.064 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:26.085 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-01T14:37:29.818 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:29.855 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:29.927 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-04-01T14:37:29.963 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T14:37:30.086 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:30.195 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-04-01T14:37:33.932 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:33.964 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:34.041 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-04-01T14:37:34.072 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T14:37:34.196 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:34.304 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-04-01T14:37:34.405 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-04-01T14:37:34.505 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-04-01T14:37:38.046 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:38.073 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:38.155 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-01T14:37:38.182 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-01T14:37:38.257 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-04-01T14:37:38.283 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-04-01T14:37:38.358 INFO:teuthology.orchestra.console.smithi138:Power on 2024-04-01T14:37:38.358 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T14:37:38.379 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2024-04-01T14:37:38.380 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:38.387 INFO:teuthology.orchestra.console.smithi142:Power on 2024-04-01T14:37:38.388 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T14:37:38.401 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-01T14:37:38.410 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-04-01T14:37:38.410 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:38.432 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-04-01T14:37:42.406 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:42.433 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:42.516 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-04-01T14:37:42.541 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-04-01T14:37:42.641 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-04-01T14:37:42.742 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-04-01T14:37:46.519 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T14:37:46.627 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-04-01T14:37:46.728 INFO:teuthology.orchestra.console.smithi138:Power on completed 2024-04-01T14:37:46.829 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2024-04-01T14:40:05.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:08.190 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-01T14:40:14.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:17.247 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-01T14:40:17.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:23.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:26.334 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-01T14:40:28.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:32.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:35.390 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-01T14:40:35.870 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T14:40:41.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:41.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:44.446 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-01T14:40:44.926 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T14:40:46.879 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-01T14:40:50.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:50.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:52.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:53.502 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-04-01T14:40:53.982 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T14:40:55.938 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-01T14:40:59.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:40:59.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:41:01.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:41:03.038 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T14:41:05.022 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-01T14:41:09.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:41:11.025 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:41:12.094 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-01T14:41:14.078 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-04-01T14:41:18.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:41:20.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:41:59.545 WARNING:teuthology.provision.fog.smithi175:timed out 2024-04-01T14:42:05.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:42:05.827 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T14:42:05.828 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T14:42:06.144 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-04-01T14:42:06.144 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-04-01T14:42:06.158 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2024-04-01T14:42:06.158 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2024-04-01T14:42:06.213 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-04-01T14:42:06.213 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-04-01T14:42:06.318 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2024-04-01T14:42:06.346 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-04-01T14:42:06.413 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2024-04-01T14:42:06.479 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-04-01T14:42:06.546 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-01T14:42:06.601 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-01T14:42:06.601 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T14:42:06.602 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T14:42:06.603 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-04-01T14:42:06.605 DEBUG:teuthology.parallel:result is None 2024-04-01T14:42:18.110 WARNING:teuthology.provision.fog.smithi138:timed out 2024-04-01T14:42:20.086 WARNING:teuthology.provision.fog.smithi142:timed out 2024-04-01T14:42:24.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:42:24.594 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T14:42:24.594 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T14:42:24.921 INFO:teuthology.provision.fog.smithi138:Node is ready 2024-04-01T14:42:24.921 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2024-04-01T14:42:24.935 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2024-04-01T14:42:24.935 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2024-04-01T14:42:24.993 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2024-04-01T14:42:24.994 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-04-01T14:42:25.105 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2024-04-01T14:42:25.133 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2024-04-01T14:42:25.204 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2024-04-01T14:42:25.275 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-04-01T14:42:25.345 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-01T14:42:25.404 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-01T14:42:25.405 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T14:42:25.405 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-01T14:42:25.405 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T14:42:25.405 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T14:42:25.405 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T14:42:25.405 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2024-04-01T14:42:25.406 DEBUG:teuthology.parallel:result is None 2024-04-01T14:42:26.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:42:26.333 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T14:42:26.333 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T14:42:26.668 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-04-01T14:42:26.669 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-04-01T14:42:26.684 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2024-04-01T14:42:26.684 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2024-04-01T14:42:26.740 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-04-01T14:42:26.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-01T14:42:26.853 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2024-04-01T14:42:26.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-04-01T14:42:26.950 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2024-04-01T14:42:27.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-04-01T14:42:27.083 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-01T14:42:27.138 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-01T14:42:27.138 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-01T14:42:27.138 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-01T14:42:27.138 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-01T14:42:27.138 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-01T14:42:27.138 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T14:42:27.139 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T14:42:27.140 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-04-01T14:42:27.140 DEBUG:teuthology.parallel:result is None 2024-04-01T14:42:27.389 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2024-04-01T14:42:27.389 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T14:42:27.418 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-04-01T14:42:27.418 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T14:42:27.434 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-04-01T14:42:27.434 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T14:42:27.452 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2024-04-01T14:42:27.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-01T14:42:27.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:42:27.540 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-01T14:42:27.610 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-01T14:42:27.610 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-01T14:42:27.670 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-01T14:42:27.670 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="9" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="9" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el9" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:LOGO="fedora-logo-icon" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-04-01T14:42:27.729 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T14:42:27.730 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T14:42:27.730 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T14:42:27.730 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-01T14:42:27.751 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-04-01T14:42:27.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T14:42:27.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:42:27.836 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-01T14:42:27.901 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-01T14:42:27.901 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-01T14:42:27.953 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-01T14:42:27.953 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-01T14:42:28.007 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T14:42:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T14:42:28.008 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T14:42:28.008 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-01T14:42:28.026 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-04-01T14:42:28.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-01T14:42:28.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T14:42:28.113 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-01T14:42:28.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-01T14:42:28.281 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-01T14:42:28.336 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-01T14:42:28.336 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-01T14:42:28.390 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-01T14:42:28.390 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-01T14:42:28.390 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-01T14:42:28.391 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-01T14:42:28.392 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-01T14:42:28.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:42:28.551 INFO:teuthology.dispatcher.supervisor:Running job 7633899 2024-04-01T14:42:28.551 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633899 --name vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/blogbench}} -- /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633899/orig.config.yaml 2024-04-01T14:42:28.555 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-01_14:09:42-fs-wip-vshankar-testing-20240330.170739-testing-default-smithi/7633899 2024-04-01T14:42:28.556 INFO:teuthology.dispatcher.supervisor:Job PID: 3030710 2024-04-01T14:42:28.556 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T14:44:28.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:46:28.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:48:28.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:50:29.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:52:29.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:54:29.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T14:54:29.551 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1