2024-03-11T09:06:28.957 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-11T09:06:28.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:06:29.126 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f81fca4bc10>, signals=[15]) 2024-03-11T09:06:29.127 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2024-03-11T09:06:29.127 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T09:06:29.127 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-03-11T09:06:29.153 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-03-11T09:06:29.153 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T09:06:29.153 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-11T09:06:29.178 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2024-03-11T09:06:29.178 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2024-03-11T09:06:29.178 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-03-11T09:06:29.258 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T09:06:29.280 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T09:06:29.303 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_centos_9.stream (ID 10) 2024-03-11T09:06:29.311 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2024-03-11T09:06:29.342 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-03-11T09:06:29.350 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of centos 9.stream 2024-03-11T09:06:29.846 INFO:teuthology.orchestra.console.smithi161:Power off 2024-03-11T09:06:29.846 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T09:06:29.870 INFO:teuthology.orchestra.console.smithi112:Power off 2024-03-11T09:06:29.870 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T09:06:29.878 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-03-11T09:06:29.879 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:29.889 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2024-03-11T09:06:29.890 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:29.903 INFO:teuthology.orchestra.console.smithi175:Power off 2024-03-11T09:06:29.903 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-11T09:06:29.911 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-11T09:06:29.911 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-11T09:06:29.927 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2024-03-11T09:06:29.927 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:29.949 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-11T09:06:30.012 INFO:teuthology.orchestra.console.smithi112:Power off completed 2024-03-11T09:06:30.113 INFO:teuthology.orchestra.console.smithi112:Power on 2024-03-11T09:06:30.113 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T09:06:30.134 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2024-03-11T09:06:30.135 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:30.159 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-11T09:06:33.914 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:33.950 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:34.024 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-11T09:06:34.060 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-11T09:06:34.161 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:34.269 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2024-03-11T09:06:38.026 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:38.061 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:38.138 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-11T09:06:38.171 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-03-11T09:06:38.270 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:38.277 INFO:teuthology.orchestra.console.smithi175:Power off completed 2024-03-11T09:06:38.378 INFO:teuthology.orchestra.console.smithi175:Power on 2024-03-11T09:06:38.378 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T09:06:38.386 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2024-03-11T09:06:38.400 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2024-03-11T09:06:38.401 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:38.422 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-03-11T09:06:38.487 INFO:teuthology.orchestra.console.smithi112:Power on completed 2024-03-11T09:06:38.588 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2024-03-11T09:06:42.142 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:42.251 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-11T09:06:42.352 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-03-11T09:06:42.422 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:42.453 INFO:teuthology.orchestra.console.smithi161:Power on 2024-03-11T09:06:42.453 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-11T09:06:42.473 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-03-11T09:06:42.474 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:42.495 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-11T09:06:42.531 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2024-03-11T09:06:46.498 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:46.532 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-11T09:06:46.607 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-11T09:06:46.708 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-03-11T09:06:46.723 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2024-03-11T09:06:46.810 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-03-11T09:06:46.824 INFO:teuthology.orchestra.console.smithi175:Power on completed 2024-03-11T09:06:46.925 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2024-03-11T09:10:27.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:30.814 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-11T09:10:36.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:39.874 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-11T09:10:45.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:48.958 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-11T09:10:54.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:10:58.016 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-11T09:11:04.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:07.102 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-11T09:11:13.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:16.158 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2024-03-11T09:11:22.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:51.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:11:54.654 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-11T09:12:00.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:03.742 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-11T09:12:06.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:09.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:09.854 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:12:12.798 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-11T09:12:15.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:18.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:18.910 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:12:21.854 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-11T09:12:22.163 WARNING:teuthology.provision.fog.smithi112:timed out 2024-03-11T09:12:24.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:27.859 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:27.966 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:12:28.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:28.388 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T09:12:28.389 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T09:12:28.705 INFO:teuthology.provision.fog.smithi112:Node is ready 2024-03-11T09:12:28.705 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2024-03-11T09:12:28.719 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2024-03-11T09:12:28.719 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2024-03-11T09:12:28.774 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2024-03-11T09:12:28.774 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-03-11T09:12:28.874 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2024-03-11T09:12:28.902 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2024-03-11T09:12:28.969 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2024-03-11T09:12:29.036 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2024-03-11T09:12:29.103 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:12:29.157 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:12:29.158 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:12:29.158 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:12:29.158 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:12:29.158 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:12:29.158 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2024-03-11T09:12:29.159 DEBUG:teuthology.parallel:result is None 2024-03-11T09:12:30.910 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-11T09:12:33.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:36.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:37.022 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:12:39.966 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2024-03-11T09:12:43.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:45.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:46.078 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:12:52.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:12:55.166 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:13:01.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:04.254 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-11T09:13:10.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:46.008 WARNING:teuthology.provision.fog.smithi175:timed out 2024-03-11T09:13:52.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:13:52.360 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T09:13:52.360 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T09:13:52.694 INFO:teuthology.provision.fog.smithi175:Node is ready 2024-03-11T09:13:52.694 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2024-03-11T09:13:52.709 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2024-03-11T09:13:52.709 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2024-03-11T09:13:52.763 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2024-03-11T09:13:52.764 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-03-11T09:13:52.859 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2024-03-11T09:13:52.886 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2024-03-11T09:13:52.953 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2024-03-11T09:13:53.021 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2024-03-11T09:13:53.088 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-03-11T09:13:53.141 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:13:53.142 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:13:53.143 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2024-03-11T09:13:53.143 DEBUG:teuthology.parallel:result is None 2024-03-11T09:14:10.261 WARNING:teuthology.provision.fog.smithi161:timed out 2024-03-11T09:14:16.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:16.554 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-11T09:14:16.555 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-11T09:14:16.894 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-03-11T09:14:16.894 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-03-11T09:14:16.908 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-03-11T09:14:16.908 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-03-11T09:14:16.964 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-03-11T09:14:16.964 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-11T09:14:17.082 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-03-11T09:14:17.110 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-03-11T09:14:17.177 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-03-11T09:14:17.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-11T09:14:17.311 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:14:17.365 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:14:17.366 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-03-11T09:14:17.366 DEBUG:teuthology.parallel:result is None 2024-03-11T09:14:17.571 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2024-03-11T09:14:17.571 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T09:14:17.593 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-03-11T09:14:17.593 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T09:14:17.618 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2024-03-11T09:14:17.618 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-11T09:14:17.644 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2024-03-11T09:14:17.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-03-11T09:14:17.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:17.731 DEBUG:teuthology.orchestra.run.smithi112:> true 2024-03-11T09:14:17.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2024-03-11T09:14:17.897 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2024-03-11T09:14:17.951 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2024-03-11T09:14:17.951 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2024-03-11T09:14:18.005 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2024-03-11T09:14:18.005 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2024-03-11T09:14:18.005 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:14:18.006 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:14:18.007 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2024-03-11T09:14:18.026 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-03-11T09:14:18.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-11T09:14:18.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:18.114 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-11T09:14:18.180 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-11T09:14:18.180 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-03-11T09:14:18.235 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-03-11T09:14:18.235 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-11T09:14:18.288 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-11T09:14:18.288 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-03-11T09:14:18.288 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:14:18.289 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:14:18.290 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-11T09:14:18.309 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2024-03-11T09:14:18.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-03-11T09:14:18.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-11T09:14:18.394 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-03-11T09:14:18.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-03-11T09:14:18.462 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-03-11T09:14:18.519 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-03-11T09:14:18.519 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-03-11T09:14:18.574 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-11T09:14:18.575 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-11T09:14:18.576 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-03-11T09:14:18.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:14:18.671 INFO:teuthology.dispatcher.supervisor:Running job 7590820 2024-03-11T09:14:18.671 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi/7590820 --name rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi --description smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} tasks/{0-install test/rados_cache_snaps}} -- /home/teuthworker/archive/rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi/7590820/orig.config.yaml 2024-03-11T09:14:18.674 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2024-03-11_09:06:05-smoke-wip-rf-compactref-distro-default-smithi/7590820 2024-03-11T09:14:18.675 INFO:teuthology.dispatcher.supervisor:Job PID: 618559 2024-03-11T09:14:18.675 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-11T09:16:18.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:18:18.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:20:19.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:22:19.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:24:19.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:26:19.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:28:19.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-11T09:28:19.912 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1