2024-03-02T00:43:01.377 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-03-02T00:43:01.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T00:43:01.559 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa94b616c10>, signals=[15]) 2024-03-02T00:43:01.559 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2024-03-02T00:43:01.559 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2024-03-02T00:43:01.560 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-03-02T00:43:01.583 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2024-03-02T00:43:01.583 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2024-03-02T00:43:01.583 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-03-02T00:43:01.608 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-03-02T00:43:01.608 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-03-02T00:43:01.608 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-03-02T00:43:01.705 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_8.stream (ID 3) 2024-03-02T00:43:01.722 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3) 2024-03-02T00:43:01.743 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_8.stream (ID 3) 2024-03-02T00:43:01.750 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 8.stream 2024-03-02T00:43:01.769 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2024-03-02T00:43:01.785 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 8.stream 2024-03-02T00:43:01.964 INFO:teuthology.orchestra.console.smithi007:Power off 2024-03-02T00:43:01.965 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-02T00:43:01.983 INFO:teuthology.orchestra.console.smithi133:Power off 2024-03-02T00:43:01.983 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-02T00:43:01.996 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2024-03-02T00:43:01.996 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:02.006 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2024-03-02T00:43:02.006 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:02.019 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2024-03-02T00:43:02.029 INFO:teuthology.orchestra.console.smithi179:Power off 2024-03-02T00:43:02.029 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-02T00:43:02.040 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-02T00:43:02.058 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-03-02T00:43:02.059 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:02.083 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-02T00:43:06.020 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:06.041 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:06.084 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:06.130 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2024-03-02T00:43:06.154 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-02T00:43:06.194 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-02T00:43:10.133 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:10.155 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:10.194 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:10.242 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-02T00:43:10.264 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-02T00:43:10.304 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-02T00:43:10.344 INFO:teuthology.orchestra.console.smithi007:Power off completed 2024-03-02T00:43:10.444 INFO:teuthology.orchestra.console.smithi007:Power on 2024-03-02T00:43:10.445 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-02T00:43:10.468 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2024-03-02T00:43:10.469 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:10.493 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-02T00:43:14.268 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:14.305 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:14.379 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-03-02T00:43:14.415 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-02T00:43:14.480 INFO:teuthology.orchestra.console.smithi133:Power off completed 2024-03-02T00:43:14.494 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:14.516 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-03-02T00:43:14.582 INFO:teuthology.orchestra.console.smithi133:Power on 2024-03-02T00:43:14.582 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-02T00:43:14.603 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2024-03-02T00:43:14.606 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2024-03-02T00:43:14.606 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:14.617 INFO:teuthology.orchestra.console.smithi179:Power on 2024-03-02T00:43:14.617 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-02T00:43:14.629 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2024-03-02T00:43:14.640 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-03-02T00:43:14.640 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:14.667 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-02T00:43:18.610 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:18.630 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:18.668 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:18.720 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2024-03-02T00:43:18.739 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2024-03-02T00:43:18.779 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-02T00:43:18.821 INFO:teuthology.orchestra.console.smithi007:Power on completed 2024-03-02T00:43:18.840 INFO:teuthology.orchestra.console.smithi133:Power on completed 2024-03-02T00:43:18.923 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2024-03-02T00:43:18.941 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2024-03-02T00:43:22.784 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-02T00:43:22.893 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-02T00:43:22.993 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-03-02T00:43:23.094 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-03-02T00:46:04.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:04.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:07.968 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T00:46:07.968 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-02T00:46:08.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:12.028 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-02T00:46:13.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:13.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:17.052 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T00:46:17.052 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-02T00:46:18.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:21.084 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-02T00:46:23.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:23.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:26.112 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T00:46:26.112 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-02T00:46:27.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:30.140 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-02T00:46:32.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:32.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:35.196 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T00:46:35.196 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-02T00:46:36.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:39.197 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-02T00:46:41.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:41.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:44.252 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-03-02T00:46:44.252 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-02T00:46:45.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:48.252 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-02T00:46:50.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:50.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:53.312 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2024-03-02T00:46:54.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:46:57.308 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-02T00:46:59.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:47:03.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:47:31.127 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-02T00:47:31.127 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-02T00:47:50.257 WARNING:teuthology.provision.fog.smithi007:timed out 2024-03-02T00:47:56.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:47:56.364 INFO:teuthology.provision.fog.smithi133:Node is ready 2024-03-02T00:47:56.365 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2024-03-02T00:47:56.389 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2024-03-02T00:47:56.390 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2024-03-02T00:47:56.452 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2024-03-02T00:47:56.454 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-03-02T00:47:56.493 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-02T00:47:56.493 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-02T00:47:56.599 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2024-03-02T00:47:56.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2024-03-02T00:47:56.702 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2024-03-02T00:47:56.744 INFO:teuthology.provision.fog.smithi007:Node is ready 2024-03-02T00:47:56.744 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2024-03-02T00:47:56.765 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2024-03-02T00:47:56.766 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2024-03-02T00:47:56.774 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2024-03-02T00:47:56.826 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2024-03-02T00:47:56.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-03-02T00:47:56.842 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-02T00:47:56.901 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-03-02T00:47:56.902 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T00:47:56.902 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-02T00:47:56.902 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T00:47:56.902 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2024-03-02T00:47:56.904 DEBUG:teuthology.parallel:result is None 2024-03-02T00:47:56.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2024-03-02T00:47:56.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2024-03-02T00:47:57.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2024-03-02T00:47:57.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2024-03-02T00:47:57.169 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T00:47:57.229 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-02T00:47:57.230 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T00:47:57.230 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2024-03-02T00:47:57.230 DEBUG:teuthology.parallel:result is None 2024-03-02T00:48:03.320 WARNING:teuthology.provision.fog.smithi179:timed out 2024-03-02T00:48:09.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:48:09.617 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-02T00:48:09.617 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-02T00:48:09.849 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-03-02T00:48:09.849 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-03-02T00:48:09.868 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2024-03-02T00:48:09.868 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2024-03-02T00:48:09.929 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2024-03-02T00:48:09.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-03-02T00:48:10.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2024-03-02T00:48:10.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2024-03-02T00:48:10.144 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2024-03-02T00:48:10.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-03-02T00:48:10.279 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-03-02T00:48:10.338 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-02T00:48:10.375 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-03-02T00:48:10.376 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-02T00:48:10.376 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-03-02T00:48:10.376 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T00:48:10.376 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-02T00:48:10.376 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T00:48:10.379 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2024-03-02T00:48:10.380 DEBUG:teuthology.parallel:result is None 2024-03-02T00:48:10.611 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2024-03-02T00:48:10.611 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-02T00:48:10.634 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2024-03-02T00:48:10.634 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-02T00:48:10.650 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2024-03-02T00:48:10.650 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-02T00:48:10.669 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2024-03-02T00:48:10.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-03-02T00:48:10.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:48:10.742 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-03-02T00:48:10.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-03-02T00:48:10.838 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-03-02T00:48:10.899 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-03-02T00:48:10.899 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-03-02T00:48:10.958 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-03-02T00:48:10.958 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-02T00:48:10.959 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T00:48:10.960 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-03-02T00:48:10.984 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2024-03-02T00:48:10.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-02T00:48:10.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:48:11.058 DEBUG:teuthology.orchestra.run.smithi133:> true 2024-03-02T00:48:11.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2024-03-02T00:48:11.192 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2024-03-02T00:48:11.250 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2024-03-02T00:48:11.250 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2024-03-02T00:48:11.309 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2024-03-02T00:48:11.309 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2024-03-02T00:48:11.309 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2024-03-02T00:48:11.309 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2024-03-02T00:48:11.309 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T00:48:11.310 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-02T00:48:11.311 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T00:48:11.311 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2024-03-02T00:48:11.335 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2024-03-02T00:48:11.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-02T00:48:11.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-02T00:48:11.411 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-03-02T00:48:11.481 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-02T00:48:11.481 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-03-02T00:48:11.542 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-03-02T00:48:11.542 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-03-02T00:48:11.603 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-03-02T00:48:11.603 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8" 2024-03-02T00:48:11.603 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-03-02T00:48:11.603 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-03-02T00:48:11.603 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8" 2024-03-02T00:48:11.603 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-02T00:48:11.604 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-02T00:48:11.605 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-03-02T00:48:11.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T00:48:11.719 INFO:teuthology.dispatcher.supervisor:Running job 7578256 2024-03-02T00:48:11.719 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-01_20:51:20-fs-squid-distro-default-smithi/7578256 --name yuriw-2024-03-01_20:51:20-fs-squid-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2024-03-01_20:51:20-fs-squid-distro-default-smithi/7578256/orig.config.yaml 2024-03-02T00:48:11.722 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-01_20:51:20-fs-squid-distro-default-smithi/7578256 2024-03-02T00:48:11.722 INFO:teuthology.dispatcher.supervisor:Job PID: 261823 2024-03-02T00:48:11.723 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-02T00:50:11.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T00:52:11.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T00:54:12.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T00:56:12.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T00:58:12.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:00:12.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:02:12.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:04:12.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:06:13.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:08:13.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:10:13.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:12:13.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:14:13.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-02T01:14:13.832 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1