2024-03-26T19:43:07.879 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-26T19:43:07.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T19:43:08.078 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb839e4fc10>, signals=[15]) 2024-03-26T19:43:08.078 INFO:teuthology.lock.ops:Start node 'smithi080.front.sepia.ceph.com' reimaging 2024-03-26T19:43:08.078 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T19:43:08.079 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-03-26T19:43:08.105 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-03-26T19:43:08.106 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T19:43:08.106 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-03-26T19:43:08.130 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2024-03-26T19:43:08.130 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2024-03-26T19:43:08.131 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-03-26T19:43:08.231 DEBUG:teuthology.provision.fog.smithi080:Requesting image smithi_centos_8.stream (ID 3) 2024-03-26T19:43:08.239 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_8.stream (ID 3) 2024-03-26T19:43:08.270 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_8.stream (ID 3) 2024-03-26T19:43:08.274 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 8.stream 2024-03-26T19:43:08.279 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.stream 2024-03-26T19:43:08.319 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream 2024-03-26T19:43:08.571 INFO:teuthology.orchestra.console.smithi088:Power off 2024-03-26T19:43:08.571 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T19:43:08.593 INFO:teuthology.orchestra.console.smithi080:Power off 2024-03-26T19:43:08.593 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T19:43:08.613 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-03-26T19:43:08.613 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:08.628 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-03-26T19:43:08.629 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:08.666 INFO:teuthology.orchestra.console.smithi138:Power off 2024-03-26T19:43:08.667 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-26T19:43:08.677 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-26T19:43:08.678 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-26T19:43:08.703 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2024-03-26T19:43:08.704 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:08.780 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-03-26T19:43:12.682 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:12.691 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:12.781 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:12.793 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-26T19:43:12.802 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-26T19:43:12.890 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-03-26T19:43:16.798 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:16.806 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:16.890 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:16.908 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-26T19:43:16.914 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-26T19:43:17.001 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-03-26T19:43:17.009 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-03-26T19:43:17.102 INFO:teuthology.orchestra.console.smithi138:Power off completed 2024-03-26T19:43:17.110 INFO:teuthology.orchestra.console.smithi088:Power on 2024-03-26T19:43:17.111 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T19:43:17.132 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-03-26T19:43:17.133 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:17.152 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-26T19:43:17.203 INFO:teuthology.orchestra.console.smithi138:Power on 2024-03-26T19:43:17.203 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T19:43:17.230 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On 2024-03-26T19:43:17.230 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:17.254 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-03-26T19:43:20.918 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:21.027 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-26T19:43:21.127 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-03-26T19:43:21.154 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:21.228 INFO:teuthology.orchestra.console.smithi080:Power on 2024-03-26T19:43:21.229 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-26T19:43:21.250 DEBUG:teuthology.orchestra.console.smithi080:power on output: Chassis Power Control: Up/On 2024-03-26T19:43:21.254 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:21.262 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:21.270 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-03-26T19:43:21.277 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-03-26T19:43:21.371 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2024-03-26T19:43:25.274 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:25.282 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:25.372 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-26T19:43:25.385 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-03-26T19:43:25.392 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-03-26T19:43:25.483 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2024-03-26T19:43:25.486 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-03-26T19:43:25.492 INFO:teuthology.orchestra.console.smithi080:Power on completed 2024-03-26T19:43:25.584 INFO:teuthology.orchestra.console.smithi138:Power on completed 2024-03-26T19:43:25.587 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-03-26T19:43:25.593 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2024-03-26T19:43:25.685 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2024-03-26T19:46:11.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:11.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:11.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:12.032 ERROR:teuthology.orchestra.connection:Error authenticating with smithi088.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-26T19:46:14.814 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-03-26T19:46:14.815 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:46:20.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:20.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:23.870 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-03-26T19:46:23.874 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:46:29.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:29.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:32.926 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-03-26T19:46:32.927 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:46:38.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:38.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:41.982 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-03-26T19:46:41.983 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:46:47.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:47.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:51.038 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:46:51.042 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-03-26T19:46:57.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:46:57.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:47:00.098 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:47:06.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:47:16.035 WARNING:teuthology.provision.fog.smithi088:timed out 2024-03-26T19:47:22.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:47:24.574 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:47:30.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:47:33.630 WARNING:teuthology.provision.fog.smithi080:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-03-26T19:47:39.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:47:40.178 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T19:47:40.179 DEBUG:teuthology.orchestra.run.smithi080:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T19:47:57.046 WARNING:teuthology.provision.fog.smithi138:timed out 2024-03-26T19:48:03.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:48:03.294 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T19:48:03.294 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T19:48:03.525 INFO:teuthology.provision.fog.smithi138:Node is ready 2024-03-26T19:48:03.525 DEBUG:teuthology.orchestra.run.smithi138:> hostname 2024-03-26T19:48:03.545 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2024-03-26T19:48:03.545 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts 2024-03-26T19:48:03.604 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2024-03-26T19:48:03.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-03-26T19:48:03.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts 2024-03-26T19:48:03.750 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts 2024-03-26T19:48:03.822 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname 2024-03-26T19:48:03.892 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138 2024-03-26T19:48:03.961 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-03-26T19:48:04.020 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T19:48:04.021 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-26T19:48:04.021 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T19:48:04.021 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2024-03-26T19:48:04.023 DEBUG:teuthology.parallel:result is None 2024-03-26T19:48:05.823 INFO:teuthology.provision.fog.smithi080:Node is ready 2024-03-26T19:48:05.823 DEBUG:teuthology.orchestra.run.smithi080:> hostname 2024-03-26T19:48:05.879 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2024-03-26T19:48:05.879 DEBUG:teuthology.orchestra.run.smithi080:> grep smithi080.front.sepia.ceph.com /etc/hosts 2024-03-26T19:48:05.941 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2024-03-26T19:48:05.942 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-03-26T19:48:06.087 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hosts 2024-03-26T19:48:06.124 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/172.21.15.80/172.21.15.80/g' /etc/hosts 2024-03-26T19:48:06.198 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i -e 's/smithi080.front.sepia.ceph.com/smithi080/g' /etc/hostname 2024-03-26T19:48:06.275 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname smithi080 2024-03-26T19:48:06.347 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-03-26T19:48:06.409 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-03-26T19:48:06.409 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-03-26T19:48:06.409 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-26T19:48:06.410 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T19:48:06.410 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2024-03-26T19:48:06.411 DEBUG:teuthology.parallel:result is None 2024-03-26T19:48:22.039 WARNING:teuthology.provision.fog.smithi088:timed out 2024-03-26T19:48:28.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:48:28.312 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-26T19:48:28.313 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-26T19:48:28.581 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-03-26T19:48:28.581 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-03-26T19:48:28.641 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-03-26T19:48:28.641 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-03-26T19:48:28.701 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-03-26T19:48:28.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-03-26T19:48:28.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-03-26T19:48:28.846 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-03-26T19:48:28.915 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-03-26T19:48:28.984 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-03-26T19:48:29.052 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-03-26T19:48:29.111 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-03-26T19:48:29.111 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-03-26T19:48:29.111 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-03-26T19:48:29.111 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-26T19:48:29.112 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T19:48:29.112 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-03-26T19:48:29.113 DEBUG:teuthology.parallel:result is None 2024-03-26T19:48:29.300 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2024-03-26T19:48:29.300 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T19:48:29.319 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-03-26T19:48:29.319 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T19:48:29.335 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2024-03-26T19:48:29.335 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-26T19:48:29.353 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2024-03-26T19:48:29.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-03-26T19:48:29.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:48:29.428 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-03-26T19:48:29.566 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-03-26T19:48:29.566 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-03-26T19:48:29.625 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-03-26T19:48:29.626 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-03-26T19:48:29.683 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-26T19:48:29.684 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T19:48:29.685 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-03-26T19:48:29.710 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-03-26T19:48:29.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-26T19:48:29.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:48:29.784 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-03-26T19:48:29.854 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-03-26T19:48:29.855 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-03-26T19:48:29.914 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-03-26T19:48:29.915 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-03-26T19:48:29.974 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-26T19:48:29.975 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-03-26T19:48:29.975 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T19:48:29.975 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-26T19:48:29.975 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T19:48:29.975 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-03-26T19:48:30.002 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2024-03-26T19:48:30.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-03-26T19:48:30.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-26T19:48:30.074 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-03-26T19:48:30.209 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-03-26T19:48:30.210 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-03-26T19:48:30.268 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-03-26T19:48:30.269 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-03-26T19:48:30.327 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-26T19:48:30.328 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-26T19:48:30.329 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-03-26T19:48:30.360 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T19:48:30.451 INFO:teuthology.dispatcher.supervisor:Running job 7623458 2024-03-26T19:48:30.451 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-26_14:32:05-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7623458 --name yuriw-2024-03-26_14:32:05-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-03-26_14:32:05-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7623458/orig.config.yaml 2024-03-26T19:48:30.454 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-26_14:32:05-rados-wip-yuri8-testing-2024-03-25-1419-distro-default-smithi/7623458 2024-03-26T19:48:30.455 INFO:teuthology.dispatcher.supervisor:Job PID: 3543642 2024-03-26T19:48:30.455 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-26T19:50:30.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T19:52:30.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T19:54:30.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T19:56:30.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T19:58:30.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:00:30.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:02:30.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:04:30.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:06:31.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:08:31.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:10:31.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:12:31.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:14:31.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:16:31.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:18:31.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:20:31.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:22:32.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:24:32.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:26:32.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:28:32.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-26T20:28:32.474 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1