2024-03-24T10:54:12.872 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-24T10:54:12.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:54:13.039 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f443e873c10>, signals=[15]) 2024-03-24T10:54:13.039 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2024-03-24T10:54:13.040 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T10:54:13.040 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-03-24T10:54:13.065 INFO:teuthology.lock.ops:Start node 'smithi177.front.sepia.ceph.com' reimaging 2024-03-24T10:54:13.065 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T10:54:13.065 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-24T10:54:13.081 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2024-03-24T10:54:13.081 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2024-03-24T10:54:13.081 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-03-24T10:54:13.161 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T10:54:13.200 DEBUG:teuthology.provision.fog.smithi177:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T10:54:13.209 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream 2024-03-24T10:54:13.229 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_9.stream (ID 10) 2024-03-24T10:54:13.244 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of centos 9.stream 2024-03-24T10:54:13.278 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 9.stream 2024-03-24T10:54:13.545 INFO:teuthology.orchestra.console.smithi150:Power off 2024-03-24T10:54:13.545 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:54:13.557 INFO:teuthology.orchestra.console.smithi177:Power off 2024-03-24T10:54:13.557 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:54:13.571 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2024-03-24T10:54:13.571 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:13.579 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-03-24T10:54:13.579 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:13.591 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-24T10:54:13.602 INFO:teuthology.orchestra.console.smithi178:Power off 2024-03-24T10:54:13.603 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-24T10:54:13.610 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-24T10:54:13.624 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2024-03-24T10:54:13.624 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:13.645 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-03-24T10:54:17.594 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:17.611 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:17.646 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:17.704 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-24T10:54:17.720 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-24T10:54:17.753 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-03-24T10:54:21.706 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:21.721 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:21.754 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:21.816 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-24T10:54:21.830 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-24T10:54:21.862 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-03-24T10:54:21.963 INFO:teuthology.orchestra.console.smithi178:Power off completed 2024-03-24T10:54:22.063 INFO:teuthology.orchestra.console.smithi178:Power on 2024-03-24T10:54:22.063 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T10:54:22.085 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2024-03-24T10:54:22.085 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:22.107 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-03-24T10:54:25.821 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:25.831 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:25.930 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-03-24T10:54:25.939 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-24T10:54:26.031 INFO:teuthology.orchestra.console.smithi150:Power off completed 2024-03-24T10:54:26.040 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-03-24T10:54:26.108 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:26.132 INFO:teuthology.orchestra.console.smithi150:Power on 2024-03-24T10:54:26.132 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T10:54:26.141 INFO:teuthology.orchestra.console.smithi177:Power on 2024-03-24T10:54:26.141 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-24T10:54:26.153 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2024-03-24T10:54:26.153 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:26.162 DEBUG:teuthology.orchestra.console.smithi177:power on output: Chassis Power Control: Up/On 2024-03-24T10:54:26.162 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:26.173 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2024-03-24T10:54:26.182 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-24T10:54:26.216 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2024-03-24T10:54:30.179 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:30.186 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:30.217 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-24T10:54:30.287 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2024-03-24T10:54:30.294 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-24T10:54:30.389 INFO:teuthology.orchestra.console.smithi150:Power on completed 2024-03-24T10:54:30.395 INFO:teuthology.orchestra.console.smithi177:Power on completed 2024-03-24T10:54:30.444 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2024-03-24T10:54:30.490 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2024-03-24T10:54:30.496 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2024-03-24T10:54:30.545 INFO:teuthology.orchestra.console.smithi178:Power on completed 2024-03-24T10:54:30.646 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2024-03-24T10:57:16.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:16.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:16.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:19.839 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:57:19.839 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:57:19.839 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-24T10:57:25.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:25.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:25.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:28.894 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:57:28.895 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:57:28.926 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-24T10:57:34.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:34.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:34.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:37.950 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:57:37.982 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-24T10:57:37.986 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:57:43.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:43.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:43.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:47.038 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:57:47.039 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-24T10:57:47.039 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:57:53.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:53.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:53.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:57:56.098 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:57:56.130 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-24T10:57:56.130 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:58:02.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:02.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:02.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:05.182 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:58:05.182 WARNING:teuthology.provision.fog.smithi177:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-24T10:58:05.214 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:58:11.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:11.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:11.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:14.238 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:58:14.270 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:58:20.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:20.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:23.298 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-03-24T10:58:29.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:38.750 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:58:44.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:47.838 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:58:53.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:58:56.926 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2024-03-24T10:59:02.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:59:03.481 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T10:59:03.482 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T10:59:11.192 WARNING:teuthology.provision.fog.smithi177:timed out 2024-03-24T10:59:17.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:59:17.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T10:59:17.561 DEBUG:teuthology.orchestra.run.smithi177:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T10:59:17.867 INFO:teuthology.provision.fog.smithi177:Node is ready 2024-03-24T10:59:17.867 DEBUG:teuthology.orchestra.run.smithi177:> hostname 2024-03-24T10:59:17.881 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2024-03-24T10:59:17.882 DEBUG:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2024-03-24T10:59:17.935 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2024-03-24T10:59:17.935 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-24T10:59:18.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2024-03-24T10:59:18.063 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2024-03-24T10:59:18.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2024-03-24T10:59:18.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2024-03-24T10:59:18.261 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:59:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:59:18.315 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:59:18.315 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:59:18.315 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:59:18.315 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2024-03-24T10:59:18.317 DEBUG:teuthology.parallel:result is None 2024-03-24T10:59:18.936 INFO:teuthology.provision.fog.smithi150:Node is ready 2024-03-24T10:59:18.936 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2024-03-24T10:59:18.954 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2024-03-24T10:59:18.955 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2024-03-24T10:59:19.012 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2024-03-24T10:59:19.012 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-03-24T10:59:19.133 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2024-03-24T10:59:19.164 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2024-03-24T10:59:19.233 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2024-03-24T10:59:19.302 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2024-03-24T10:59:19.369 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-03-24T10:59:19.424 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-03-24T10:59:19.424 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-03-24T10:59:19.424 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-03-24T10:59:19.424 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:59:19.425 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:59:19.425 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2024-03-24T10:59:19.426 DEBUG:teuthology.parallel:result is None 2024-03-24T10:59:29.314 WARNING:teuthology.provision.fog.smithi178:timed out 2024-03-24T10:59:35.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:59:35.570 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-24T10:59:35.570 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-24T10:59:35.900 INFO:teuthology.provision.fog.smithi178:Node is ready 2024-03-24T10:59:35.901 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2024-03-24T10:59:35.915 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2024-03-24T10:59:35.916 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2024-03-24T10:59:35.972 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2024-03-24T10:59:35.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-03-24T10:59:36.078 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2024-03-24T10:59:36.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2024-03-24T10:59:36.177 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2024-03-24T10:59:36.244 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2024-03-24T10:59:36.311 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-03-24T10:59:36.366 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:59:36.367 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:59:36.368 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:59:36.368 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2024-03-24T10:59:36.368 DEBUG:teuthology.parallel:result is None 2024-03-24T10:59:36.578 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2024-03-24T10:59:36.579 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T10:59:36.599 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2024-03-24T10:59:36.599 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T10:59:36.632 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2024-03-24T10:59:36.632 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-24T10:59:36.649 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2024-03-24T10:59:36.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-03-24T10:59:36.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:59:36.739 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-03-24T10:59:36.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-03-24T10:59:36.908 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-03-24T10:59:36.963 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-03-24T10:59:36.964 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-03-24T10:59:37.018 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2024-03-24T10:59:37.018 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2024-03-24T10:59:37.018 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2024-03-24T10:59:37.018 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:59:37.018 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:59:37.019 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:59:37.020 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-03-24T10:59:37.049 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2024-03-24T10:59:37.049 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-24T10:59:37.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:59:37.136 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-03-24T10:59:37.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-24T10:59:37.309 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-03-24T10:59:37.364 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-03-24T10:59:37.364 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:59:37.419 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:59:37.420 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-24T10:59:37.449 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2024-03-24T10:59:37.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-03-24T10:59:37.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:59:37.537 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-03-24T10:59:37.607 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-03-24T10:59:37.607 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-03-24T10:59:37.663 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-03-24T10:59:37.805 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-03-24T10:59:37.821 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2024-03-24T10:59:37.821 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="9" 2024-03-24T10:59:37.821 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="9" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:59:37.822 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:59:37.823 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-03-24T10:59:37.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:59:37.936 INFO:teuthology.dispatcher.supervisor:Running job 7617874 2024-03-24T10:59:37.936 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi/7617874 --name teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi --description orch/cephadm/smoke-small/{0-distro/centos_9.stream_runc 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi/7617874/orig.config.yaml 2024-03-24T10:59:37.939 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-03-22_21:08:02-orch-squid-distro-default-smithi/7617874 2024-03-24T10:59:37.939 INFO:teuthology.dispatcher.supervisor:Job PID: 3993183 2024-03-24T10:59:37.939 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-24T11:01:38.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:03:38.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:05:38.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:07:38.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:09:38.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:11:38.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:13:39.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:15:39.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:17:39.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T11:17:39.466 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1