2024-04-18T23:24:54.831 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T23:24:54.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:24:55.000 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6bee3f9c10>, signals=[15]) 2024-04-18T23:24:55.000 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-04-18T23:24:55.001 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:24:55.001 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-18T23:24:55.017 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2024-04-18T23:24:55.018 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:24:55.018 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-18T23:24:55.041 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2024-04-18T23:24:55.042 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:24:55.042 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-04-18T23:24:55.159 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_8.stream (ID 3) 2024-04-18T23:24:55.162 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_centos_8.stream (ID 3) 2024-04-18T23:24:55.178 DEBUG:teuthology.provision.fog.smithi116:Requesting image smithi_centos_8.stream (ID 3) 2024-04-18T23:24:55.206 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of centos 8.stream 2024-04-18T23:24:55.209 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream 2024-04-18T23:24:55.238 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of centos 8.stream 2024-04-18T23:24:55.494 INFO:teuthology.orchestra.console.smithi072:Power off 2024-04-18T23:24:55.494 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:24:55.509 INFO:teuthology.orchestra.console.smithi116:Power off 2024-04-18T23:24:55.509 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:24:55.521 INFO:teuthology.orchestra.console.smithi029:Power off 2024-04-18T23:24:55.521 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:24:55.529 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2024-04-18T23:24:55.530 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:55.538 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2024-04-18T23:24:55.539 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:55.547 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-04-18T23:24:55.548 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:55.556 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-18T23:24:55.561 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-04-18T23:24:55.571 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-18T23:24:55.658 INFO:teuthology.orchestra.console.smithi072:Power off completed 2024-04-18T23:24:55.662 INFO:teuthology.orchestra.console.smithi116:Power off completed 2024-04-18T23:24:55.672 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-04-18T23:24:55.759 INFO:teuthology.orchestra.console.smithi072:Power on 2024-04-18T23:24:55.759 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:24:55.767 INFO:teuthology.orchestra.console.smithi116:Power on 2024-04-18T23:24:55.767 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:24:55.774 INFO:teuthology.orchestra.console.smithi029:Power on 2024-04-18T23:24:55.774 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:24:55.783 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2024-04-18T23:24:55.783 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:55.792 DEBUG:teuthology.orchestra.console.smithi116:power on output: Chassis Power Control: Up/On 2024-04-18T23:24:55.792 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:55.801 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-04-18T23:24:55.802 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:55.810 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2024-04-18T23:24:55.814 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2024-04-18T23:24:55.823 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-04-18T23:24:59.813 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:59.821 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:59.827 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:24:59.922 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2024-04-18T23:24:59.929 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2024-04-18T23:24:59.936 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-04-18T23:25:00.024 INFO:teuthology.orchestra.console.smithi072:Power on completed 2024-04-18T23:25:00.030 INFO:teuthology.orchestra.console.smithi116:Power on completed 2024-04-18T23:25:00.038 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-04-18T23:25:00.125 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2024-04-18T23:25:00.132 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2024-04-18T23:25:00.138 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-04-18T23:27:46.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:27:49.086 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-18T23:27:55.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:27:58.142 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-18T23:28:04.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:07.201 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-18T23:28:13.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:16.138 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:16.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:16.286 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-18T23:28:19.198 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-18T23:28:19.199 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-18T23:28:22.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:25.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:25.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:25.342 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-18T23:28:28.254 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-18T23:28:28.286 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-18T23:28:31.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:34.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:34.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:34.398 WARNING:teuthology.provision.fog.smithi116:[Errno None] Unable to connect to port 22 on 172.21.15.116 2024-04-18T23:28:37.314 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-18T23:28:37.342 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-18T23:28:40.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:43.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:43.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:46.398 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-18T23:28:46.398 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-18T23:28:52.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:52.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:28:55.458 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-18T23:28:55.459 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-04-18T23:29:01.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:29:01.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:29:04.546 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-04-18T23:29:10.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:29:40.431 WARNING:teuthology.provision.fog.smithi116:timed out 2024-04-18T23:29:46.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:29:46.690 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T23:29:46.691 DEBUG:teuthology.orchestra.run.smithi116:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T23:29:46.943 INFO:teuthology.provision.fog.smithi116:Node is ready 2024-04-18T23:29:46.943 DEBUG:teuthology.orchestra.run.smithi116:> hostname 2024-04-18T23:29:46.963 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2024-04-18T23:29:46.963 DEBUG:teuthology.orchestra.run.smithi116:> grep smithi116.front.sepia.ceph.com /etc/hosts 2024-04-18T23:29:47.022 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2024-04-18T23:29:47.022 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2024-04-18T23:29:47.114 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hosts 2024-04-18T23:29:47.143 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/172.21.15.116/172.21.15.116/g' /etc/hosts 2024-04-18T23:29:47.211 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i -e 's/smithi116.front.sepia.ceph.com/smithi116/g' /etc/hostname 2024-04-18T23:29:47.279 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname smithi116 2024-04-18T23:29:47.346 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T23:29:47.404 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-04-18T23:29:47.405 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T23:29:47.405 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:29:47.405 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:29:47.405 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T23:29:47.405 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:29:47.405 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2024-04-18T23:29:47.407 DEBUG:teuthology.parallel:result is None 2024-04-18T23:30:01.478 WARNING:teuthology.provision.fog.smithi029:timed out 2024-04-18T23:30:07.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:30:07.822 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T23:30:07.822 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T23:30:08.063 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-04-18T23:30:08.063 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-04-18T23:30:08.082 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2024-04-18T23:30:08.082 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2024-04-18T23:30:08.145 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2024-04-18T23:30:08.146 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-04-18T23:30:08.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2024-04-18T23:30:08.311 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2024-04-18T23:30:08.384 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2024-04-18T23:30:08.457 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-04-18T23:30:08.530 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-18T23:30:08.592 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-18T23:30:08.592 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2024-04-18T23:30:08.592 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-18T23:30:08.592 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:30:08.592 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T23:30:08.593 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:30:08.593 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-04-18T23:30:08.594 DEBUG:teuthology.parallel:result is None 2024-04-18T23:30:10.556 WARNING:teuthology.provision.fog.smithi072:timed out 2024-04-18T23:30:16.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:30:16.950 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T23:30:16.951 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T23:30:17.243 INFO:teuthology.provision.fog.smithi072:Node is ready 2024-04-18T23:30:17.244 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2024-04-18T23:30:17.263 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2024-04-18T23:30:17.263 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2024-04-18T23:30:17.322 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2024-04-18T23:30:17.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2024-04-18T23:30:17.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2024-04-18T23:30:17.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2024-04-18T23:30:17.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2024-04-18T23:30:17.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2024-04-18T23:30:17.675 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T23:30:17.734 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-04-18T23:30:17.735 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T23:30:17.735 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:30:17.735 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:30:17.735 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T23:30:17.735 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:30:17.735 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2024-04-18T23:30:17.736 DEBUG:teuthology.parallel:result is None 2024-04-18T23:30:17.942 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-04-18T23:30:17.943 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T23:30:17.959 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2024-04-18T23:30:17.959 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T23:30:17.974 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2024-04-18T23:30:17.974 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T23:30:17.993 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-04-18T23:30:17.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-18T23:30:17.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:30:18.067 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-04-18T23:30:18.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-04-18T23:30:18.140 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-04-18T23:30:18.202 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-04-18T23:30:18.203 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-04-18T23:30:18.263 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T23:30:18.264 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:30:18.265 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-04-18T23:30:18.283 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2024-04-18T23:30:18.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-18T23:30:18.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:30:18.367 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-04-18T23:30:18.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-04-18T23:30:18.437 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-04-18T23:30:18.497 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-04-18T23:30:18.497 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-04-18T23:30:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-04-18T23:30:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8" 2024-04-18T23:30:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-04-18T23:30:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T23:30:18.556 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:30:18.557 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-04-18T23:30:18.583 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2024-04-18T23:30:18.583 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-18T23:30:18.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:30:18.661 DEBUG:teuthology.orchestra.run.smithi116:> true 2024-04-18T23:30:18.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2024-04-18T23:30:18.801 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2024-04-18T23:30:18.863 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2024-04-18T23:30:18.864 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2024-04-18T23:30:18.925 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2024-04-18T23:30:18.925 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2024-04-18T23:30:18.925 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2024-04-18T23:30:18.925 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:30:18.925 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T23:30:18.926 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:30:18.926 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2024-04-18T23:30:18.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:30:19.044 INFO:teuthology.dispatcher.supervisor:Running job 7663069 2024-04-18T23:30:19.044 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663069 --name yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663069/orig.config.yaml 2024-04-18T23:30:19.053 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663069 2024-04-18T23:30:19.054 INFO:teuthology.dispatcher.supervisor:Job PID: 2133169 2024-04-18T23:30:19.054 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T23:32:19.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:34:19.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:36:19.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:38:19.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:40:19.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:42:19.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:44:20.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:46:20.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:48:20.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:50:20.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:52:20.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:54:20.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:56:21.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:58:21.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:00:21.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:02:21.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:04:21.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:06:22.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:08:22.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:10:22.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T00:10:22.497 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1