2024-02-17T12:39:54.660 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T12:39:54.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:39:54.843 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8488524c10>, signals=[15]) 2024-02-17T12:39:54.844 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2024-02-17T12:39:54.845 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T12:39:54.845 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-02-17T12:39:54.872 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2024-02-17T12:39:54.872 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T12:39:54.873 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-02-17T12:39:54.897 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2024-02-17T12:39:54.897 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2024-02-17T12:39:54.897 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-02-17T12:39:54.991 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_centos_8.stream (ID 3) 2024-02-17T12:39:55.003 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_8.stream (ID 3) 2024-02-17T12:39:55.028 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 8.stream 2024-02-17T12:39:55.031 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3) 2024-02-17T12:39:55.050 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2024-02-17T12:39:55.090 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2024-02-17T12:39:55.297 INFO:teuthology.orchestra.console.smithi001:Power off 2024-02-17T12:39:55.297 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T12:39:55.310 INFO:teuthology.orchestra.console.smithi163:Power off 2024-02-17T12:39:55.310 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T12:39:55.318 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2024-02-17T12:39:55.318 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:55.334 INFO:teuthology.orchestra.console.smithi192:Power off 2024-02-17T12:39:55.334 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T12:39:55.343 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-02-17T12:39:55.343 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-02-17T12:39:55.344 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:55.354 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2024-02-17T12:39:55.354 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:55.363 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-02-17T12:39:55.375 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-02-17T12:39:55.444 INFO:teuthology.orchestra.console.smithi001:Power off completed 2024-02-17T12:39:55.464 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-02-17T12:39:55.476 INFO:teuthology.orchestra.console.smithi192:Power off completed 2024-02-17T12:39:55.545 INFO:teuthology.orchestra.console.smithi001:Power on 2024-02-17T12:39:55.546 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T12:39:55.565 INFO:teuthology.orchestra.console.smithi163:Power on 2024-02-17T12:39:55.565 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T12:39:55.576 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On 2024-02-17T12:39:55.576 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:55.584 INFO:teuthology.orchestra.console.smithi192:Power on 2024-02-17T12:39:55.584 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-17T12:39:55.593 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2024-02-17T12:39:55.594 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:55.601 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-02-17T12:39:55.605 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2024-02-17T12:39:55.605 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:55.615 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-02-17T12:39:55.628 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-02-17T12:39:59.605 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:59.616 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:59.629 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:39:59.714 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-02-17T12:39:59.725 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-02-17T12:39:59.737 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-02-17T12:40:03.719 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:40:03.726 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:40:03.738 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T12:40:03.828 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-02-17T12:40:03.835 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-02-17T12:40:03.929 INFO:teuthology.orchestra.console.smithi001:Power on completed 2024-02-17T12:40:03.936 INFO:teuthology.orchestra.console.smithi163:Power on completed 2024-02-17T12:40:03.946 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-02-17T12:40:04.030 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2024-02-17T12:40:04.038 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2024-02-17T12:40:04.046 INFO:teuthology.orchestra.console.smithi192:Power on completed 2024-02-17T12:40:04.148 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2024-02-17T12:42:34.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:42:34.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:42:53.372 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-17T12:42:53.373 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:42:59.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:42:59.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:02.432 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-17T12:43:02.432 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:43:05.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:08.160 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:43:08.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:08.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:11.488 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-17T12:43:11.516 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:43:14.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:17.248 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:43:17.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:17.517 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:20.540 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1 2024-02-17T12:43:20.572 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:43:23.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:26.332 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:43:26.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:26.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:29.628 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:43:32.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:35.388 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:43:35.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:41.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:44.448 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:43:50.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:43:53.500 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:43:54.044 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:43:59.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:00.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:02.588 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:44:03.100 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-17T12:44:08.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:09.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:11.649 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:44:12.255 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T12:44:12.256 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T12:44:17.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:20.704 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-17T12:44:26.543 WARNING:teuthology.provision.fog.smithi001:timed out 2024-02-17T12:44:26.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:32.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:44:32.767 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T12:44:32.768 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T12:44:33.021 INFO:teuthology.provision.fog.smithi001:Node is ready 2024-02-17T12:44:33.021 DEBUG:teuthology.orchestra.run.smithi001:> hostname 2024-02-17T12:44:33.041 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2024-02-17T12:44:33.042 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts 2024-02-17T12:44:33.103 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2024-02-17T12:44:33.103 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2024-02-17T12:44:33.216 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts 2024-02-17T12:44:33.249 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts 2024-02-17T12:44:33.320 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname 2024-02-17T12:44:33.390 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001 2024-02-17T12:44:33.461 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-02-17T12:44:33.520 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-02-17T12:44:33.520 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8" 2024-02-17T12:44:33.520 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-02-17T12:44:33.520 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:44:33.520 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8" 2024-02-17T12:44:33.520 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T12:44:33.521 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:44:33.522 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2024-02-17T12:44:33.523 DEBUG:teuthology.parallel:result is None 2024-02-17T12:44:37.542 INFO:teuthology.provision.fog.smithi192:Node is ready 2024-02-17T12:44:37.542 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2024-02-17T12:44:37.566 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2024-02-17T12:44:37.566 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2024-02-17T12:44:37.628 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2024-02-17T12:44:37.628 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-02-17T12:44:37.759 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2024-02-17T12:44:37.792 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2024-02-17T12:44:37.864 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2024-02-17T12:44:37.934 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-02-17T12:44:38.003 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:44:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:44:38.063 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T12:44:38.063 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:44:38.063 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2024-02-17T12:44:38.063 DEBUG:teuthology.parallel:result is None 2024-02-17T12:45:26.752 WARNING:teuthology.provision.fog.smithi163:timed out 2024-02-17T12:45:32.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:45:32.997 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-17T12:45:32.997 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-17T12:45:33.248 INFO:teuthology.provision.fog.smithi163:Node is ready 2024-02-17T12:45:33.248 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2024-02-17T12:45:33.267 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2024-02-17T12:45:33.267 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2024-02-17T12:45:33.327 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2024-02-17T12:45:33.327 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-02-17T12:45:33.436 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2024-02-17T12:45:33.465 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2024-02-17T12:45:33.534 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2024-02-17T12:45:33.603 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-02-17T12:45:33.670 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-02-17T12:45:33.727 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T12:45:33.728 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:45:33.729 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:45:33.729 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T12:45:33.729 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:45:33.729 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2024-02-17T12:45:33.730 DEBUG:teuthology.parallel:result is None 2024-02-17T12:45:33.924 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2024-02-17T12:45:33.925 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T12:45:33.954 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2024-02-17T12:45:33.954 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T12:45:33.979 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2024-02-17T12:45:33.979 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-17T12:45:33.997 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2024-02-17T12:45:33.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-02-17T12:45:33.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:45:34.069 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-02-17T12:45:34.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-02-17T12:45:34.167 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-02-17T12:45:34.227 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-02-17T12:45:34.227 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-02-17T12:45:34.287 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-02-17T12:45:34.287 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8" 2024-02-17T12:45:34.287 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-02-17T12:45:34.287 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T12:45:34.288 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:45:34.289 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-02-17T12:45:34.313 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2024-02-17T12:45:34.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-02-17T12:45:34.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:45:34.385 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-02-17T12:45:34.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-02-17T12:45:34.456 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-02-17T12:45:34.515 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-02-17T12:45:34.515 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-02-17T12:45:34.574 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-02-17T12:45:34.574 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T12:45:34.575 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:45:34.576 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-02-17T12:45:34.596 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2024-02-17T12:45:34.596 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-02-17T12:45:34.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T12:45:34.691 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-02-17T12:45:34.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-02-17T12:45:34.830 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-02-17T12:45:34.889 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-02-17T12:45:34.890 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-02-17T12:45:34.949 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-02-17T12:45:34.950 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2024-02-17T12:45:34.950 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-02-17T12:45:34.950 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-02-17T12:45:34.950 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2024-02-17T12:45:34.950 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2024-02-17T12:45:34.950 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T12:45:34.951 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-02-17T12:45:34.951 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T12:45:34.951 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-02-17T12:45:34.951 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T12:45:34.951 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T12:45:34.951 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T12:45:34.952 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-02-17T12:45:34.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:45:35.083 INFO:teuthology.dispatcher.supervisor:Running job 7563205 2024-02-17T12:45:35.084 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563205 --name yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/no pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} -- /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563205/orig.config.yaml 2024-02-17T12:45:35.087 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-16_20:13:25-fs-main-distro-default-smithi/7563205 2024-02-17T12:45:35.087 INFO:teuthology.dispatcher.supervisor:Job PID: 3635775 2024-02-17T12:45:35.087 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-17T12:47:35.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:49:35.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:51:35.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:53:35.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:55:35.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:57:36.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T12:59:36.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:01:36.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:03:36.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:05:36.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:07:36.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:09:37.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:11:37.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T13:11:37.282 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1