2024-03-16T18:08:51.035 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-16T18:08:51.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:08:51.215 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe8c05bac10>, signals=[15]) 2024-03-16T18:08:51.215 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2024-03-16T18:08:51.215 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T18:08:51.215 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-03-16T18:08:51.232 INFO:teuthology.lock.ops:Start node 'smithi137.front.sepia.ceph.com' reimaging 2024-03-16T18:08:51.232 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T18:08:51.232 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-03-16T18:08:51.257 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-03-16T18:08:51.257 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-03-16T18:08:51.257 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-03-16T18:08:51.359 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2024-03-16T18:08:51.377 DEBUG:teuthology.provision.fog.smithi137:Requesting image smithi_centos_8.stream (ID 3) 2024-03-16T18:08:51.389 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3) 2024-03-16T18:08:51.402 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2024-03-16T18:08:51.414 INFO:teuthology.provision.fog.smithi137:Scheduling deploy of centos 8.stream 2024-03-16T18:08:51.439 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2024-03-16T18:08:51.622 INFO:teuthology.orchestra.console.smithi137:Power off 2024-03-16T18:08:51.623 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T18:08:51.637 INFO:teuthology.orchestra.console.smithi090:Power off 2024-03-16T18:08:51.637 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T18:08:51.645 DEBUG:teuthology.orchestra.console.smithi137:power off output: Chassis Power Control: Down/Off 2024-03-16T18:08:51.645 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:51.663 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2024-03-16T18:08:51.663 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:51.672 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-03-16T18:08:51.690 INFO:teuthology.orchestra.console.smithi169:Power off 2024-03-16T18:08:51.691 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-16T18:08:51.697 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-16T18:08:51.715 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-03-16T18:08:51.716 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:51.738 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-03-16T18:08:51.798 INFO:teuthology.orchestra.console.smithi090:Power off completed 2024-03-16T18:08:51.899 INFO:teuthology.orchestra.console.smithi090:Power on 2024-03-16T18:08:51.899 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T18:08:51.921 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2024-03-16T18:08:51.921 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:51.943 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-16T18:08:55.674 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:55.739 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:55.783 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-03-16T18:08:55.848 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-03-16T18:08:55.885 INFO:teuthology.orchestra.console.smithi137:Power off completed 2024-03-16T18:08:55.944 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:55.952 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-03-16T18:08:55.986 INFO:teuthology.orchestra.console.smithi137:Power on 2024-03-16T18:08:55.986 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T18:08:56.007 DEBUG:teuthology.orchestra.console.smithi137:power on output: Chassis Power Control: Up/On 2024-03-16T18:08:56.008 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:56.030 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is off 2024-03-16T18:08:56.053 INFO:teuthology.orchestra.console.smithi169:Power on 2024-03-16T18:08:56.053 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-16T18:08:56.060 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2024-03-16T18:08:56.074 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-03-16T18:08:56.074 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:08:56.096 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-03-16T18:09:00.034 DEBUG:teuthology.orchestra.console.smithi137:pexpect command: ipmitool -H smithi137.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:09:00.061 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:09:00.097 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:09:00.143 DEBUG:teuthology.orchestra.console.smithi137:check power output: Chassis Power is on 2024-03-16T18:09:00.171 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2024-03-16T18:09:00.206 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-03-16T18:09:00.244 INFO:teuthology.orchestra.console.smithi137:Power on completed 2024-03-16T18:09:00.272 INFO:teuthology.orchestra.console.smithi090:Power on completed 2024-03-16T18:09:00.345 INFO:teuthology.provision.fog.smithi137:Waiting for deploy to finish 2024-03-16T18:09:00.373 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2024-03-16T18:09:04.211 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-16T18:09:04.320 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-03-16T18:09:04.420 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-03-16T18:09:04.521 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-03-16T18:11:46.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:11:50.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:01.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:04.766 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-16T18:12:08.862 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-16T18:12:10.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:13.822 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-16T18:12:14.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:17.918 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-16T18:12:19.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:19.870 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:12:22.878 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-16T18:12:23.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:25.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:26.974 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-16T18:12:28.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:28.930 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:12:31.934 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-16T18:12:32.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:34.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:36.030 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-16T18:12:37.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:37.982 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:12:40.990 WARNING:teuthology.provision.fog.smithi137:[Errno None] Unable to connect to port 22 on 172.21.15.137 2024-03-16T18:12:42.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:43.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:45.086 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-16T18:12:46.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:47.038 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:12:51.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:53.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:12:54.142 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-16T18:12:56.094 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:13:00.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:13:02.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:13:05.150 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:13:11.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:13:14.206 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2024-03-16T18:13:20.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:13:47.022 WARNING:teuthology.provision.fog.smithi137:timed out 2024-03-16T18:13:53.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:13:53.229 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T18:13:53.229 DEBUG:teuthology.orchestra.run.smithi137:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T18:13:53.488 INFO:teuthology.provision.fog.smithi137:Node is ready 2024-03-16T18:13:53.489 DEBUG:teuthology.orchestra.run.smithi137:> hostname 2024-03-16T18:13:53.548 INFO:teuthology.orchestra.run.smithi137.stdout:smithi137.front.sepia.ceph.com 2024-03-16T18:13:53.548 DEBUG:teuthology.orchestra.run.smithi137:> grep smithi137.front.sepia.ceph.com /etc/hosts 2024-03-16T18:13:53.608 INFO:teuthology.orchestra.run.smithi137.stdout:172.21.15.137 smithi137.front.sepia.ceph.com smithi137 2024-03-16T18:13:53.608 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-03-16T18:13:53.709 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hosts 2024-03-16T18:13:53.739 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/172.21.15.137/172.21.15.137/g' /etc/hosts 2024-03-16T18:13:53.808 DEBUG:teuthology.orchestra.run.smithi137:> sudo sed -i -e 's/smithi137.front.sepia.ceph.com/smithi137/g' /etc/hostname 2024-03-16T18:13:53.877 DEBUG:teuthology.orchestra.run.smithi137:> sudo hostname smithi137 2024-03-16T18:13:53.944 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-03-16T18:13:54.002 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-03-16T18:13:54.002 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2024-03-16T18:13:54.002 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-03-16T18:13:54.002 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-16T18:13:54.003 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T18:13:54.004 INFO:teuthology.provision.fog.smithi137:Deploy complete! 2024-03-16T18:13:54.005 DEBUG:teuthology.parallel:result is None 2024-03-16T18:14:00.159 WARNING:teuthology.provision.fog.smithi169:timed out 2024-03-16T18:14:06.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:14:06.396 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T18:14:06.396 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T18:14:06.647 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-03-16T18:14:06.647 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-03-16T18:14:06.666 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-03-16T18:14:06.666 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-03-16T18:14:06.725 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-03-16T18:14:06.726 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-03-16T18:14:06.834 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-03-16T18:14:06.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-03-16T18:14:06.933 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-03-16T18:14:07.001 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-03-16T18:14:07.068 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-16T18:14:07.127 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T18:14:07.128 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-03-16T18:14:07.128 DEBUG:teuthology.parallel:result is None 2024-03-16T18:14:20.225 WARNING:teuthology.provision.fog.smithi090:timed out 2024-03-16T18:14:26.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:14:26.568 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-16T18:14:26.568 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-16T18:14:26.898 INFO:teuthology.provision.fog.smithi090:Node is ready 2024-03-16T18:14:26.898 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2024-03-16T18:14:26.919 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2024-03-16T18:14:26.919 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2024-03-16T18:14:26.981 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2024-03-16T18:14:26.981 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-03-16T18:14:27.129 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2024-03-16T18:14:27.160 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2024-03-16T18:14:27.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2024-03-16T18:14:27.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2024-03-16T18:14:27.370 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-03-16T18:14:27.429 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-03-16T18:14:27.429 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-16T18:14:27.430 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T18:14:27.431 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2024-03-16T18:14:27.431 DEBUG:teuthology.parallel:result is None 2024-03-16T18:14:27.620 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2024-03-16T18:14:27.620 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T18:14:27.643 INFO:teuthology.lock.ops:Checking smithi137.front.sepia.ceph.com 2024-03-16T18:14:27.643 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T18:14:27.660 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-03-16T18:14:27.660 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-16T18:14:27.677 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2024-03-16T18:14:27.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-16T18:14:27.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:14:27.748 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-03-16T18:14:27.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-03-16T18:14:27.816 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-03-16T18:14:27.874 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-03-16T18:14:27.874 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-16T18:14:27.932 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-03-16T18:14:27.933 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-16T18:14:27.933 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-03-16T18:14:27.933 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T18:14:27.933 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-16T18:14:27.933 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T18:14:27.933 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-03-16T18:14:27.952 INFO:teuthology.lock.ops:Updating [smithi137.front.sepia.ceph.com]: set os type and version on server 2024-03-16T18:14:27.952 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-16T18:14:27.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi137.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:14:28.022 DEBUG:teuthology.orchestra.run.smithi137:> true 2024-03-16T18:14:28.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi137.front.sepia.ceph.com' 2024-03-16T18:14:28.113 DEBUG:teuthology.orchestra.run.smithi137:> uname -m 2024-03-16T18:14:28.171 INFO:teuthology.orchestra.run.smithi137.stdout:x86_64 2024-03-16T18:14:28.171 DEBUG:teuthology.orchestra.run.smithi137:> cat /etc/os-release 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:NAME="CentOS Stream" 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION="8" 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:ID="centos" 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:ID_LIKE="rhel fedora" 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:VERSION_ID="8" 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:PLATFORM_ID="platform:el8" 2024-03-16T18:14:28.229 INFO:teuthology.orchestra.run.smithi137.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-16T18:14:28.230 INFO:teuthology.orchestra.run.smithi137.stdout:ANSI_COLOR="0;31" 2024-03-16T18:14:28.230 INFO:teuthology.orchestra.run.smithi137.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-16T18:14:28.230 INFO:teuthology.orchestra.run.smithi137.stdout:HOME_URL="https://centos.org/" 2024-03-16T18:14:28.230 INFO:teuthology.orchestra.run.smithi137.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T18:14:28.230 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-16T18:14:28.230 INFO:teuthology.orchestra.run.smithi137.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T18:14:28.230 INFO:teuthology.lock.ops:Updating smithi137.front.sepia.ceph.com on lock server 2024-03-16T18:14:28.253 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-03-16T18:14:28.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-03-16T18:14:28.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-16T18:14:28.328 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-03-16T18:14:28.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-03-16T18:14:28.466 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-03-16T18:14:28.525 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-03-16T18:14:28.526 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-03-16T18:14:28.584 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-03-16T18:14:28.584 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2024-03-16T18:14:28.584 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-03-16T18:14:28.584 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-03-16T18:14:28.584 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-16T18:14:28.585 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-16T18:14:28.586 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-03-16T18:14:28.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:14:28.721 INFO:teuthology.dispatcher.supervisor:Running job 7602050 2024-03-16T18:14:28.722 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602050 --name leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602050/orig.config.yaml 2024-03-16T18:14:28.725 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-03-15_11:44:52-fs-wip-lusov-qdb-squid-distro-default-smithi/7602050 2024-03-16T18:14:28.725 INFO:teuthology.dispatcher.supervisor:Job PID: 3406762 2024-03-16T18:14:28.725 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-16T18:16:28.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:18:29.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:20:29.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:22:29.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:24:29.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:26:29.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:28:29.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:30:30.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:32:30.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:34:30.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:36:30.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:38:30.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:40:30.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-16T18:40:30.880 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1