2024-03-09T23:55:10.490 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-09T23:55:10.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T23:55:10.715 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f098192cc10>, signals=[15]) 2024-03-09T23:55:10.716 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2024-03-09T23:55:10.716 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2024-03-09T23:55:10.717 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-03-09T23:55:10.739 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging 2024-03-09T23:55:10.740 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server 2024-03-09T23:55:10.740 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-03-09T23:55:10.764 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-03-09T23:55:10.765 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-03-09T23:55:10.765 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-09T23:55:10.854 DEBUG:teuthology.provision.fog.smithi142:Requesting image smithi_centos_8.stream (ID 3) 2024-03-09T23:55:10.895 DEBUG:teuthology.provision.fog.smithi155:Requesting image smithi_centos_8.stream (ID 3) 2024-03-09T23:55:10.901 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2024-03-09T23:55:10.915 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of centos 8.stream 2024-03-09T23:55:10.936 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream 2024-03-09T23:55:10.948 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2024-03-09T23:55:11.174 INFO:teuthology.orchestra.console.smithi142:Power off 2024-03-09T23:55:11.174 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T23:55:11.192 INFO:teuthology.orchestra.console.smithi161:Power off 2024-03-09T23:55:11.192 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T23:55:11.205 INFO:teuthology.orchestra.console.smithi155:Power off 2024-03-09T23:55:11.206 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T23:55:11.213 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2024-03-09T23:55:11.213 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:11.222 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-03-09T23:55:11.222 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:11.231 DEBUG:teuthology.orchestra.console.smithi155:power off output: Chassis Power Control: Down/Off 2024-03-09T23:55:11.232 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:11.240 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-09T23:55:11.245 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-09T23:55:11.254 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-03-09T23:55:15.246 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:15.253 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:15.262 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:15.355 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-09T23:55:15.364 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-09T23:55:15.374 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-03-09T23:55:19.358 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:19.365 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:19.375 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:19.466 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-09T23:55:19.474 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-09T23:55:19.483 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-03-09T23:55:19.576 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-03-09T23:55:19.584 INFO:teuthology.orchestra.console.smithi155:Power off completed 2024-03-09T23:55:19.677 INFO:teuthology.orchestra.console.smithi161:Power on 2024-03-09T23:55:19.677 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-09T23:55:19.685 INFO:teuthology.orchestra.console.smithi155:Power on 2024-03-09T23:55:19.685 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-09T23:55:19.699 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-03-09T23:55:19.699 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:19.708 DEBUG:teuthology.orchestra.console.smithi155:power on output: Chassis Power Control: Up/On 2024-03-09T23:55:19.709 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:19.722 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-09T23:55:19.730 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-03-09T23:55:23.470 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:23.581 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-03-09T23:55:23.682 INFO:teuthology.orchestra.console.smithi142:Power off completed 2024-03-09T23:55:23.724 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:23.731 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:23.783 INFO:teuthology.orchestra.console.smithi142:Power on 2024-03-09T23:55:23.784 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-09T23:55:23.807 DEBUG:teuthology.orchestra.console.smithi142:power on output: Chassis Power Control: Up/On 2024-03-09T23:55:23.808 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:23.833 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-03-09T23:55:23.833 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2024-03-09T23:55:23.840 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is off 2024-03-09T23:55:27.838 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:27.846 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:27.855 DEBUG:teuthology.orchestra.console.smithi155:pexpect command: ipmitool -H smithi155.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T23:55:27.948 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-03-09T23:55:27.957 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2024-03-09T23:55:27.964 DEBUG:teuthology.orchestra.console.smithi155:check power output: Chassis Power is on 2024-03-09T23:55:28.050 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-03-09T23:55:28.058 INFO:teuthology.orchestra.console.smithi142:Power on completed 2024-03-09T23:55:28.066 INFO:teuthology.orchestra.console.smithi155:Power on completed 2024-03-09T23:55:28.151 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-03-09T23:55:28.159 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2024-03-09T23:55:28.166 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2024-03-09T23:58:14.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:14.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:14.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:14.276 ERROR:teuthology.orchestra.connection:Error authenticating with smithi155.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-03-09T23:58:17.122 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-03-09T23:58:17.123 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:58:23.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:23.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:26.174 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-03-09T23:58:26.206 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:58:32.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:32.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:35.234 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-03-09T23:58:35.266 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:58:41.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:41.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:44.286 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-03-09T23:58:44.322 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:58:50.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:50.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:53.346 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-03-09T23:58:53.374 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:58:59.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:58:59.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:59:02.402 WARNING:teuthology.provision.fog.smithi142:[Errno None] Unable to connect to port 22 on 172.21.15.142 2024-03-09T23:59:02.430 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:59:08.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:59:08.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:59:11.490 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-03-09T23:59:17.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T23:59:18.280 WARNING:teuthology.provision.fog.smithi155:timed out 2024-03-09T23:59:24.281 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:08.406 WARNING:teuthology.provision.fog.smithi142:timed out 2024-03-10T00:00:14.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:14.639 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-10T00:00:14.640 DEBUG:teuthology.orchestra.run.smithi142:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-10T00:00:14.894 INFO:teuthology.provision.fog.smithi142:Node is ready 2024-03-10T00:00:14.895 DEBUG:teuthology.orchestra.run.smithi142:> hostname 2024-03-10T00:00:14.913 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2024-03-10T00:00:14.914 DEBUG:teuthology.orchestra.run.smithi142:> grep smithi142.front.sepia.ceph.com /etc/hosts 2024-03-10T00:00:14.973 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2024-03-10T00:00:14.974 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-03-10T00:00:15.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hosts 2024-03-10T00:00:15.111 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/172.21.15.142/172.21.15.142/g' /etc/hosts 2024-03-10T00:00:15.178 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i -e 's/smithi142.front.sepia.ceph.com/smithi142/g' /etc/hostname 2024-03-10T00:00:15.246 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname smithi142 2024-03-10T00:00:15.313 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-03-10T00:00:15.371 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-03-10T00:00:15.371 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2024-03-10T00:00:15.371 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-10T00:00:15.372 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T00:00:15.373 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2024-03-10T00:00:15.374 DEBUG:teuthology.parallel:result is None 2024-03-10T00:00:17.495 WARNING:teuthology.provision.fog.smithi161:timed out 2024-03-10T00:00:23.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:23.743 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-10T00:00:23.743 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-10T00:00:23.988 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-03-10T00:00:23.988 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-03-10T00:00:24.048 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-03-10T00:00:24.048 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-03-10T00:00:24.107 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-03-10T00:00:24.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-10T00:00:24.216 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-03-10T00:00:24.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-03-10T00:00:24.283 WARNING:teuthology.provision.fog.smithi155:timed out 2024-03-10T00:00:24.313 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-03-10T00:00:24.382 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-03-10T00:00:24.450 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-10T00:00:24.508 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-10T00:00:24.508 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-03-10T00:00:24.508 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-10T00:00:24.508 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-10T00:00:24.509 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T00:00:24.509 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-03-10T00:00:24.510 DEBUG:teuthology.parallel:result is None 2024-03-10T00:00:30.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:30.558 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-10T00:00:30.558 DEBUG:teuthology.orchestra.run.smithi155:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-10T00:00:30.820 INFO:teuthology.provision.fog.smithi155:Node is ready 2024-03-10T00:00:30.820 DEBUG:teuthology.orchestra.run.smithi155:> hostname 2024-03-10T00:00:30.839 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155 2024-03-10T00:00:30.840 DEBUG:teuthology.orchestra.run.smithi155:> grep smithi155 /etc/hosts 2024-03-10T00:00:30.899 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2024-03-10T00:00:30.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2024-03-10T00:00:30.998 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155/smithi155/g' /etc/hosts 2024-03-10T00:00:31.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/172.21.15.155/172.21.15.155/g' /etc/hosts 2024-03-10T00:00:31.096 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i -e 's/smithi155/smithi155/g' /etc/hostname 2024-03-10T00:00:31.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname smithi155 2024-03-10T00:00:31.231 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-03-10T00:00:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-03-10T00:00:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2024-03-10T00:00:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-03-10T00:00:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-03-10T00:00:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2024-03-10T00:00:31.289 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-10T00:00:31.290 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T00:00:31.290 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2024-03-10T00:00:31.291 DEBUG:teuthology.parallel:result is None 2024-03-10T00:00:31.482 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2024-03-10T00:00:31.483 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-10T00:00:31.508 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2024-03-10T00:00:31.508 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-10T00:00:31.524 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-03-10T00:00:31.525 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-10T00:00:31.551 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2024-03-10T00:00:31.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-10T00:00:31.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:31.632 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-03-10T00:00:31.766 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-03-10T00:00:31.766 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-03-10T00:00:31.824 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-03-10T00:00:31.825 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-03-10T00:00:31.884 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-03-10T00:00:31.884 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2024-03-10T00:00:31.884 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-03-10T00:00:31.884 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-03-10T00:00:31.884 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2024-03-10T00:00:31.884 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-10T00:00:31.885 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T00:00:31.885 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-03-10T00:00:31.917 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2024-03-10T00:00:31.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-03-10T00:00:31.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:31.989 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-03-10T00:00:32.014 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-03-10T00:00:32.014 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-03-10T00:00:32.074 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-03-10T00:00:32.074 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-03-10T00:00:32.132 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-03-10T00:00:32.132 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2024-03-10T00:00:32.132 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-03-10T00:00:32.132 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-03-10T00:00:32.132 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2024-03-10T00:00:32.132 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-10T00:00:32.133 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T00:00:32.133 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-03-10T00:00:32.158 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-03-10T00:00:32.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-10T00:00:32.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-10T00:00:32.232 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-03-10T00:00:32.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-03-10T00:00:32.304 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-03-10T00:00:32.366 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-03-10T00:00:32.366 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-03-10T00:00:32.426 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-03-10T00:00:32.426 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-03-10T00:00:32.426 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-03-10T00:00:32.426 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-10T00:00:32.427 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-10T00:00:32.427 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-03-10T00:00:32.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:00:32.617 INFO:teuthology.dispatcher.supervisor:Running job 7587632 2024-03-10T00:00:32.617 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi/7587632 --name yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/quincy backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi/7587632/orig.config.yaml 2024-03-10T00:00:32.621 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-08_16:18:36-rados-wip-yuri8-testing-2024-03-06-1329-distro-default-smithi/7587632 2024-03-10T00:00:32.621 INFO:teuthology.dispatcher.supervisor:Job PID: 1154331 2024-03-10T00:00:32.622 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-10T00:02:32.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:04:32.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:06:32.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:08:32.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:10:32.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:12:32.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:14:33.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:16:33.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-10T00:16:33.188 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1