2024-04-17T09:46:38.059 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T09:46:38.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:46:38.232 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2d55f86c10>, signals=[15]) 2024-04-17T09:46:38.233 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging 2024-04-17T09:46:38.233 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:46:38.233 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-17T09:46:38.256 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2024-04-17T09:46:38.257 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:46:38.257 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-17T09:46:38.281 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2024-04-17T09:46:38.281 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T09:46:38.281 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-17T09:46:38.376 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:46:38.389 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:46:38.422 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T09:46:38.435 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 9.stream 2024-04-17T09:46:38.438 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream 2024-04-17T09:46:38.477 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2024-04-17T09:46:38.732 INFO:teuthology.orchestra.console.smithi057:Power off 2024-04-17T09:46:38.733 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:46:38.746 INFO:teuthology.orchestra.console.smithi115:Power off 2024-04-17T09:46:38.746 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:46:38.755 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-04-17T09:46:38.755 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:38.768 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off 2024-04-17T09:46:38.769 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:38.777 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-17T09:46:38.791 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-17T09:46:38.798 INFO:teuthology.orchestra.console.smithi129:Power off 2024-04-17T09:46:38.798 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T09:46:38.818 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-04-17T09:46:38.818 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:38.838 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T09:46:38.878 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-04-17T09:46:38.891 INFO:teuthology.orchestra.console.smithi115:Power off completed 2024-04-17T09:46:38.939 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-04-17T09:46:38.979 INFO:teuthology.orchestra.console.smithi057:Power on 2024-04-17T09:46:38.979 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:46:38.992 INFO:teuthology.orchestra.console.smithi115:Power on 2024-04-17T09:46:38.993 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:46:39.001 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On 2024-04-17T09:46:39.002 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:39.013 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On 2024-04-17T09:46:39.013 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:39.022 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-17T09:46:39.035 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off 2024-04-17T09:46:39.040 INFO:teuthology.orchestra.console.smithi129:Power on 2024-04-17T09:46:39.040 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T09:46:39.060 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2024-04-17T09:46:39.060 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:39.083 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-04-17T09:46:43.028 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:43.035 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:43.085 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:43.137 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-04-17T09:46:43.143 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on 2024-04-17T09:46:43.193 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-04-17T09:46:43.244 INFO:teuthology.orchestra.console.smithi115:Power on completed 2024-04-17T09:46:43.294 INFO:teuthology.orchestra.console.smithi129:Power on completed 2024-04-17T09:46:43.345 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2024-04-17T09:46:43.394 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2024-04-17T09:46:47.141 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T09:46:47.249 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-04-17T09:46:47.350 INFO:teuthology.orchestra.console.smithi057:Power on completed 2024-04-17T09:46:47.451 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2024-04-17T09:50:15.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:18.174 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T09:50:24.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:27.230 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T09:50:33.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:36.286 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T09:50:42.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:45.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:45.374 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T09:50:48.350 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T09:50:49.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:51.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:52.318 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:50:54.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:50:54.430 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T09:50:57.410 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T09:50:58.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:00.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:01.374 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:51:03.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:03.486 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-04-17T09:51:06.494 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T09:51:07.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:09.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:10.430 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:51:12.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:15.550 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T09:51:16.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:19.486 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:51:21.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:24.606 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T09:51:25.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:28.542 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:51:30.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:33.662 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-04-17T09:51:34.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:37.598 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:51:39.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:43.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:51:46.654 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-04-17T09:51:52.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:52:09.510 WARNING:teuthology.provision.fog.smithi129:timed out 2024-04-17T09:52:15.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:52:16.066 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:52:16.066 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:52:16.389 INFO:teuthology.provision.fog.smithi129:Node is ready 2024-04-17T09:52:16.389 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2024-04-17T09:52:16.404 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2024-04-17T09:52:16.404 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2024-04-17T09:52:16.460 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2024-04-17T09:52:16.460 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-17T09:52:16.605 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2024-04-17T09:52:16.635 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2024-04-17T09:52:16.703 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2024-04-17T09:52:16.771 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2024-04-17T09:52:16.838 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:52:16.893 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:52:16.894 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:52:16.894 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:52:16.894 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2024-04-17T09:52:16.896 DEBUG:teuthology.parallel:result is None 2024-04-17T09:52:39.686 WARNING:teuthology.provision.fog.smithi115:timed out 2024-04-17T09:52:45.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:52:45.936 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:52:45.937 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:52:46.261 INFO:teuthology.provision.fog.smithi115:Node is ready 2024-04-17T09:52:46.261 DEBUG:teuthology.orchestra.run.smithi115:> hostname 2024-04-17T09:52:46.276 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2024-04-17T09:52:46.277 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts 2024-04-17T09:52:46.332 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2024-04-17T09:52:46.332 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-04-17T09:52:46.447 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts 2024-04-17T09:52:46.475 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts 2024-04-17T09:52:46.542 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname 2024-04-17T09:52:46.608 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115 2024-04-17T09:52:46.675 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-17T09:52:46.729 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-17T09:52:46.729 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-04-17T09:52:46.729 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-17T09:52:46.729 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:52:46.729 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:52:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:52:46.731 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2024-04-17T09:52:46.731 DEBUG:teuthology.parallel:result is None 2024-04-17T09:52:52.667 WARNING:teuthology.provision.fog.smithi057:timed out 2024-04-17T09:52:58.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:52:58.951 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T09:52:58.952 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T09:52:59.305 INFO:teuthology.provision.fog.smithi057:Node is ready 2024-04-17T09:52:59.305 DEBUG:teuthology.orchestra.run.smithi057:> hostname 2024-04-17T09:52:59.320 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2024-04-17T09:52:59.320 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts 2024-04-17T09:52:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2024-04-17T09:52:59.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-04-17T09:52:59.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts 2024-04-17T09:52:59.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts 2024-04-17T09:52:59.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname 2024-04-17T09:52:59.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057 2024-04-17T09:52:59.720 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-17T09:52:59.774 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-17T09:52:59.774 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-04-17T09:52:59.774 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:52:59.775 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:52:59.775 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2024-04-17T09:52:59.776 DEBUG:teuthology.parallel:result is None 2024-04-17T09:52:59.986 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2024-04-17T09:52:59.986 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:53:00.015 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2024-04-17T09:53:00.015 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:53:00.030 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2024-04-17T09:53:00.030 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T09:53:00.047 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:53:00.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-17T09:53:00.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:53:00.147 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-17T09:53:00.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-17T09:53:00.212 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-17T09:53:00.267 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-17T09:53:00.267 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-17T09:53:00.322 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:53:00.323 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:53:00.324 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-17T09:53:00.346 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:53:00.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-17T09:53:00.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:53:00.433 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-04-17T09:53:00.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-04-17T09:53:00.600 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-04-17T09:53:00.655 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-04-17T09:53:00.656 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:53:00.711 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:53:00.712 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:53:00.712 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-04-17T09:53:00.730 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2024-04-17T09:53:00.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-17T09:53:00.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T09:53:00.816 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-04-17T09:53:00.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-04-17T09:53:00.980 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-04-17T09:53:01.034 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-04-17T09:53:01.034 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T09:53:01.088 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-04-17T09:53:01.089 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T09:53:01.089 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T09:53:01.089 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T09:53:01.089 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-04-17T09:53:01.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:53:01.222 INFO:teuthology.dispatcher.supervisor:Running job 7660047 2024-04-17T09:53:01.222 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660047 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660047/orig.config.yaml 2024-04-17T09:53:01.225 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7660047 2024-04-17T09:53:01.225 INFO:teuthology.dispatcher.supervisor:Job PID: 729911 2024-04-17T09:53:01.226 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T09:55:01.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:57:01.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T09:59:01.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:01:01.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T10:01:01.903 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1