2024-01-31T04:40:03.206 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-01-31T04:40:03.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:40:03.369 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7eff72987c10>, signals=[15]) 2024-01-31T04:40:03.369 INFO:teuthology.lock.ops:Start node 'smithi008.front.sepia.ceph.com' reimaging 2024-01-31T04:40:03.370 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: reset os type and version on server 2024-01-31T04:40:03.370 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-01-31T04:40:03.384 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-01-31T04:40:03.384 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-01-31T04:40:03.384 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-31T04:40:03.409 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2024-01-31T04:40:03.409 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2024-01-31T04:40:03.409 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-01-31T04:40:03.472 DEBUG:teuthology.provision.fog.smithi008:Requesting image smithi_centos_9.stream (ID 10) 2024-01-31T04:40:03.526 INFO:teuthology.provision.fog.smithi008:Scheduling deploy of centos 9.stream 2024-01-31T04:40:03.529 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_9.stream (ID 10) 2024-01-31T04:40:03.546 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10) 2024-01-31T04:40:03.569 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 9.stream 2024-01-31T04:40:03.585 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream 2024-01-31T04:40:03.824 INFO:teuthology.orchestra.console.smithi008:Power off 2024-01-31T04:40:03.824 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T04:40:03.844 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2024-01-31T04:40:03.844 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:03.865 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-01-31T04:40:03.902 INFO:teuthology.orchestra.console.smithi029:Power off 2024-01-31T04:40:03.902 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T04:40:03.917 INFO:teuthology.orchestra.console.smithi102:Power off 2024-01-31T04:40:03.918 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T04:40:03.926 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-01-31T04:40:03.927 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:03.940 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-01-31T04:40:03.940 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:03.948 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-31T04:40:03.960 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-31T04:40:03.966 INFO:teuthology.orchestra.console.smithi008:Power off completed 2024-01-31T04:40:04.049 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-01-31T04:40:04.061 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-01-31T04:40:04.067 INFO:teuthology.orchestra.console.smithi008:Power on 2024-01-31T04:40:04.067 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-31T04:40:04.089 DEBUG:teuthology.orchestra.console.smithi008:power on output: Chassis Power Control: Up/On 2024-01-31T04:40:04.089 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:04.110 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-01-31T04:40:04.150 INFO:teuthology.orchestra.console.smithi029:Power on 2024-01-31T04:40:04.150 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-31T04:40:04.162 INFO:teuthology.orchestra.console.smithi102:Power on 2024-01-31T04:40:04.162 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-31T04:40:04.171 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-01-31T04:40:04.171 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:04.187 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2024-01-31T04:40:04.187 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:04.195 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-01-31T04:40:04.211 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-01-31T04:40:08.112 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:08.196 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:08.211 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:08.222 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2024-01-31T04:40:08.306 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-01-31T04:40:08.321 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-01-31T04:40:08.407 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-01-31T04:40:08.422 INFO:teuthology.orchestra.console.smithi102:Power on completed 2024-01-31T04:40:08.508 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-01-31T04:40:08.523 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2024-01-31T04:40:12.226 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T04:40:12.335 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2024-01-31T04:40:12.435 INFO:teuthology.orchestra.console.smithi008:Power on completed 2024-01-31T04:40:12.536 INFO:teuthology.provision.fog.smithi008:Waiting for deploy to finish 2024-01-31T04:42:43.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:42:47.036 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-01-31T04:42:53.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:42:56.092 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-01-31T04:43:02.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:05.180 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-01-31T04:43:10.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:11.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:13.404 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-31T04:43:14.236 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-01-31T04:43:19.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:20.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:22.492 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-31T04:43:23.292 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-01-31T04:43:28.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:29.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:31.548 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-31T04:43:32.348 WARNING:teuthology.provision.fog.smithi008:[Errno None] Unable to connect to port 22 on 172.21.15.8 2024-01-31T04:43:37.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:38.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:40.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:40.636 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-31T04:43:43.548 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:43:46.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:49.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:49.692 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-31T04:43:52.607 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:43:55.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:58.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:43:58.748 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-01-31T04:44:01.692 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:44:04.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:07.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:10.748 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:44:16.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:19.804 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:44:25.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:28.860 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:44:34.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:37.916 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-01-31T04:44:38.353 WARNING:teuthology.provision.fog.smithi008:timed out 2024-01-31T04:44:43.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:44.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:44:44.603 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-31T04:44:44.604 DEBUG:teuthology.orchestra.run.smithi008:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-31T04:44:44.947 INFO:teuthology.provision.fog.smithi008:Node is ready 2024-01-31T04:44:44.947 DEBUG:teuthology.orchestra.run.smithi008:> hostname 2024-01-31T04:44:44.962 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008.front.sepia.ceph.com 2024-01-31T04:44:44.962 DEBUG:teuthology.orchestra.run.smithi008:> grep smithi008.front.sepia.ceph.com /etc/hosts 2024-01-31T04:44:45.018 INFO:teuthology.orchestra.run.smithi008.stdout:172.21.15.8 smithi008.front.sepia.ceph.com smithi008 2024-01-31T04:44:45.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-01-31T04:44:45.141 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hosts 2024-01-31T04:44:45.172 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/172.21.15.8/172.21.15.8/g' /etc/hosts 2024-01-31T04:44:45.243 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i -e 's/smithi008.front.sepia.ceph.com/smithi008/g' /etc/hostname 2024-01-31T04:44:45.313 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname smithi008 2024-01-31T04:44:45.383 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:44:45.439 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:44:45.440 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:44:45.440 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:44:45.440 INFO:teuthology.provision.fog.smithi008:Deploy complete! 2024-01-31T04:44:45.442 DEBUG:teuthology.parallel:result is None 2024-01-31T04:45:04.772 WARNING:teuthology.provision.fog.smithi029:timed out 2024-01-31T04:45:10.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:11.083 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-31T04:45:11.083 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-31T04:45:11.444 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-01-31T04:45:11.444 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-01-31T04:45:11.459 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2024-01-31T04:45:11.459 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2024-01-31T04:45:11.515 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2024-01-31T04:45:11.515 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-01-31T04:45:11.659 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2024-01-31T04:45:11.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2024-01-31T04:45:11.763 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2024-01-31T04:45:11.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-01-31T04:45:11.904 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:11.959 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:11.960 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:11.960 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:11.960 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:11.960 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:11.960 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-01-31T04:45:11.961 DEBUG:teuthology.parallel:result is None 2024-01-31T04:45:43.947 WARNING:teuthology.provision.fog.smithi102:timed out 2024-01-31T04:45:49.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:50.276 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-31T04:45:50.277 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-31T04:45:50.606 INFO:teuthology.provision.fog.smithi102:Node is ready 2024-01-31T04:45:50.606 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2024-01-31T04:45:50.620 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2024-01-31T04:45:50.620 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2024-01-31T04:45:50.675 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2024-01-31T04:45:50.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-01-31T04:45:50.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2024-01-31T04:45:50.813 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2024-01-31T04:45:50.880 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2024-01-31T04:45:50.946 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-01-31T04:45:51.013 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-01-31T04:45:51.070 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-01-31T04:45:51.070 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-01-31T04:45:51.070 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-01-31T04:45:51.070 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:51.070 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-01-31T04:45:51.070 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:51.071 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:51.071 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2024-01-31T04:45:51.072 DEBUG:teuthology.parallel:result is None 2024-01-31T04:45:51.612 INFO:teuthology.lock.ops:Checking smithi008.front.sepia.ceph.com 2024-01-31T04:45:51.612 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-31T04:45:51.633 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-01-31T04:45:51.633 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-31T04:45:51.657 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2024-01-31T04:45:51.658 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-31T04:45:51.683 INFO:teuthology.lock.ops:Updating [smithi008.front.sepia.ceph.com]: set os type and version on server 2024-01-31T04:45:51.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-01-31T04:45:51.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:51.830 DEBUG:teuthology.orchestra.run.smithi008:> true 2024-01-31T04:45:52.016 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2024-01-31T04:45:52.016 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2024-01-31T04:45:52.073 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2024-01-31T04:45:52.073 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="CentOS Stream" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="9" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:ID="centos" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="9" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:52.129 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:52.130 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:52.130 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:52.130 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:52.130 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2024-01-31T04:45:52.149 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-01-31T04:45:52.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-31T04:45:52.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:52.254 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-01-31T04:45:52.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-01-31T04:45:52.434 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-01-31T04:45:52.489 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-01-31T04:45:52.490 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-01-31T04:45:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-01-31T04:45:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="9" 2024-01-31T04:45:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-01-31T04:45:52.544 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="9" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:52.545 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:52.546 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-01-31T04:45:52.566 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2024-01-31T04:45:52.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-31T04:45:52.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T04:45:52.653 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-01-31T04:45:52.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-01-31T04:45:52.723 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-01-31T04:45:52.778 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-01-31T04:45:52.778 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-01-31T04:45:52.833 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-31T04:45:52.834 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-01-31T04:45:52.834 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-31T04:45:52.834 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-31T04:45:52.834 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-31T04:45:52.834 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-01-31T04:45:52.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:45:52.969 INFO:teuthology.dispatcher.supervisor:Running job 7539477 2024-01-31T04:45:52.969 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539477 --name vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/fs/norstats}} -- /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539477/orig.config.yaml 2024-01-31T04:45:52.971 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-31_04:15:12-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7539477 2024-01-31T04:45:52.972 INFO:teuthology.dispatcher.supervisor:Job PID: 1135960 2024-01-31T04:45:52.972 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-31T04:47:53.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:49:53.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:51:53.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:53:53.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:55:53.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:57:53.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:59:54.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T04:59:54.072 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1