2024-03-25T01:41:42.858 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-25T01:41:42.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:41:43.046 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f423edd8c10>, signals=[15]) 2024-03-25T01:41:43.047 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2024-03-25T01:41:43.047 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T01:41:43.047 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-03-25T01:41:43.070 INFO:teuthology.lock.ops:Start node 'smithi070.front.sepia.ceph.com' reimaging 2024-03-25T01:41:43.071 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T01:41:43.071 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-03-25T01:41:43.095 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2024-03-25T01:41:43.095 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2024-03-25T01:41:43.095 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-03-25T01:41:43.186 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_8.stream (ID 3) 2024-03-25T01:41:43.209 DEBUG:teuthology.provision.fog.smithi070:Requesting image smithi_centos_8.stream (ID 3) 2024-03-25T01:41:43.217 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_8.stream (ID 3) 2024-03-25T01:41:43.230 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream 2024-03-25T01:41:43.271 INFO:teuthology.provision.fog.smithi070:Scheduling deploy of centos 8.stream 2024-03-25T01:41:43.275 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 8.stream 2024-03-25T01:41:43.525 INFO:teuthology.orchestra.console.smithi017:Power off 2024-03-25T01:41:43.525 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T01:41:43.547 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-03-25T01:41:43.548 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:43.573 INFO:teuthology.orchestra.console.smithi070:Power off 2024-03-25T01:41:43.573 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T01:41:43.587 INFO:teuthology.orchestra.console.smithi076:Power off 2024-03-25T01:41:43.587 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-25T01:41:43.594 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-25T01:41:43.597 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-03-25T01:41:43.597 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:43.608 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-03-25T01:41:43.609 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:43.619 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-25T01:41:43.632 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-03-25T01:41:47.600 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:47.620 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:47.633 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:47.708 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-25T01:41:47.730 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-25T01:41:47.742 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-03-25T01:41:51.710 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:51.731 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:51.743 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:51.820 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-03-25T01:41:51.839 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-25T01:41:51.854 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-03-25T01:41:51.921 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-03-25T01:41:51.955 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-03-25T01:41:52.022 INFO:teuthology.orchestra.console.smithi017:Power on 2024-03-25T01:41:52.022 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T01:41:52.045 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2024-03-25T01:41:52.045 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:52.056 INFO:teuthology.orchestra.console.smithi076:Power on 2024-03-25T01:41:52.056 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T01:41:52.065 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-03-25T01:41:52.077 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-03-25T01:41:52.077 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:52.104 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-03-25T01:41:55.843 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:55.952 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-25T01:41:56.053 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-03-25T01:41:56.066 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:56.105 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:56.154 INFO:teuthology.orchestra.console.smithi070:Power on 2024-03-25T01:41:56.154 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-25T01:41:56.175 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-03-25T01:41:56.178 DEBUG:teuthology.orchestra.console.smithi070:power on output: Chassis Power Control: Up/On 2024-03-25T01:41:56.178 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:41:56.200 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-25T01:41:56.215 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-03-25T01:42:00.178 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:42:00.201 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:42:00.216 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:42:00.288 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-25T01:42:00.310 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-03-25T01:42:00.389 INFO:teuthology.orchestra.console.smithi017:Power on completed 2024-03-25T01:42:00.393 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-03-25T01:42:00.490 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2024-03-25T01:42:00.494 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-03-25T01:42:00.595 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2024-03-25T01:42:04.315 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-25T01:42:04.424 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-03-25T01:42:04.525 INFO:teuthology.orchestra.console.smithi070:Power on completed 2024-03-25T01:42:04.626 INFO:teuthology.provision.fog.smithi070:Waiting for deploy to finish 2024-03-25T01:44:31.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:44:34.974 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-03-25T01:44:40.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:44:44.030 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-03-25T01:44:50.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:44:51.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:44:53.086 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-03-25T01:44:54.238 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-25T01:44:59.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:00.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:02.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:02.142 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-03-25T01:45:03.294 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-25T01:45:05.182 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:45:08.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:09.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:11.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:11.198 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-03-25T01:45:12.350 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-25T01:45:14.238 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:45:17.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:18.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:20.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:21.406 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-25T01:45:23.294 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:45:27.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:29.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:30.462 WARNING:teuthology.provision.fog.smithi070:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-03-25T01:45:32.354 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:45:36.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:38.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:41.410 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:45:47.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:50.494 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:45:56.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:45:59.582 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-03-25T01:46:05.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:46:17.214 WARNING:teuthology.provision.fog.smithi017:timed out 2024-03-25T01:46:23.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:46:23.428 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T01:46:23.429 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T01:46:23.812 INFO:teuthology.provision.fog.smithi017:Node is ready 2024-03-25T01:46:23.812 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2024-03-25T01:46:23.833 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2024-03-25T01:46:23.834 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2024-03-25T01:46:23.895 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2024-03-25T01:46:23.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-03-25T01:46:24.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2024-03-25T01:46:24.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2024-03-25T01:46:24.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2024-03-25T01:46:24.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-03-25T01:46:24.251 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-03-25T01:46:24.309 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-03-25T01:46:24.309 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T01:46:24.310 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T01:46:24.311 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2024-03-25T01:46:24.312 DEBUG:teuthology.parallel:result is None 2024-03-25T01:46:36.478 WARNING:teuthology.provision.fog.smithi070:timed out 2024-03-25T01:46:42.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:46:42.824 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T01:46:42.824 DEBUG:teuthology.orchestra.run.smithi070:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T01:46:43.102 INFO:teuthology.provision.fog.smithi070:Node is ready 2024-03-25T01:46:43.102 DEBUG:teuthology.orchestra.run.smithi070:> hostname 2024-03-25T01:46:43.121 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070.front.sepia.ceph.com 2024-03-25T01:46:43.122 DEBUG:teuthology.orchestra.run.smithi070:> grep smithi070.front.sepia.ceph.com /etc/hosts 2024-03-25T01:46:43.182 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70 smithi070.front.sepia.ceph.com smithi070 2024-03-25T01:46:43.183 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-03-25T01:46:43.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hosts 2024-03-25T01:46:43.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/172.21.15.70/172.21.15.70/g' /etc/hosts 2024-03-25T01:46:43.384 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i -e 's/smithi070.front.sepia.ceph.com/smithi070/g' /etc/hostname 2024-03-25T01:46:43.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname smithi070 2024-03-25T01:46:43.519 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-03-25T01:46:43.577 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-03-25T01:46:43.577 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2024-03-25T01:46:43.577 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T01:46:43.578 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T01:46:43.578 INFO:teuthology.provision.fog.smithi070:Deploy complete! 2024-03-25T01:46:43.579 DEBUG:teuthology.parallel:result is None 2024-03-25T01:47:05.610 WARNING:teuthology.provision.fog.smithi076:timed out 2024-03-25T01:47:11.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:47:11.841 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-25T01:47:11.841 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-25T01:47:12.085 INFO:teuthology.provision.fog.smithi076:Node is ready 2024-03-25T01:47:12.085 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2024-03-25T01:47:12.106 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2024-03-25T01:47:12.107 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2024-03-25T01:47:12.168 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2024-03-25T01:47:12.168 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-03-25T01:47:12.263 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2024-03-25T01:47:12.298 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2024-03-25T01:47:12.372 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2024-03-25T01:47:12.446 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-03-25T01:47:12.518 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-03-25T01:47:12.580 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-03-25T01:47:12.580 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-03-25T01:47:12.580 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-03-25T01:47:12.580 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T01:47:12.581 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T01:47:12.581 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2024-03-25T01:47:12.582 DEBUG:teuthology.parallel:result is None 2024-03-25T01:47:12.813 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2024-03-25T01:47:12.813 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T01:47:12.837 INFO:teuthology.lock.ops:Checking smithi070.front.sepia.ceph.com 2024-03-25T01:47:12.837 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T01:47:12.853 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2024-03-25T01:47:12.853 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-25T01:47:12.872 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2024-03-25T01:47:12.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-25T01:47:12.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:47:12.949 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-25T01:47:13.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-25T01:47:13.085 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-03-25T01:47:13.146 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-03-25T01:47:13.146 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T01:47:13.206 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-03-25T01:47:13.207 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T01:47:13.207 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-03-25T01:47:13.207 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T01:47:13.207 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T01:47:13.207 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T01:47:13.207 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-03-25T01:47:13.248 INFO:teuthology.lock.ops:Updating [smithi070.front.sepia.ceph.com]: set os type and version on server 2024-03-25T01:47:13.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-25T01:47:13.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:47:13.322 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-03-25T01:47:13.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-03-25T01:47:13.457 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-03-25T01:47:13.519 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-03-25T01:47:13.519 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-03-25T01:47:13.578 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-03-25T01:47:13.578 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="8" 2024-03-25T01:47:13.578 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-03-25T01:47:13.578 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="8" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el8" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T01:47:13.579 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T01:47:13.579 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-03-25T01:47:13.604 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2024-03-25T01:47:13.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-25T01:47:13.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-25T01:47:13.677 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-03-25T01:47:13.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-03-25T01:47:13.707 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-03-25T01:47:13.769 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-03-25T01:47:13.769 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-03-25T01:47:13.831 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-03-25T01:47:13.831 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-03-25T01:47:13.831 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-03-25T01:47:13.831 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-03-25T01:47:13.831 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-03-25T01:47:13.831 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-25T01:47:13.832 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-25T01:47:13.832 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-03-25T01:47:13.862 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:47:13.960 INFO:teuthology.dispatcher.supervisor:Running job 7620804 2024-03-25T01:47:13.960 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-25_00:22:23-rados-wip-yuri3-testing-2024-03-24-1519-distro-default-smithi/7620804 --name yuriw-2024-03-25_00:22:23-rados-wip-yuri3-testing-2024-03-24-1519-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/quincy backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} -- /home/teuthworker/archive/yuriw-2024-03-25_00:22:23-rados-wip-yuri3-testing-2024-03-24-1519-distro-default-smithi/7620804/orig.config.yaml 2024-03-25T01:47:13.963 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-25_00:22:23-rados-wip-yuri3-testing-2024-03-24-1519-distro-default-smithi/7620804 2024-03-25T01:47:13.963 INFO:teuthology.dispatcher.supervisor:Job PID: 549638 2024-03-25T01:47:13.963 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-25T01:49:14.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:51:14.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:53:14.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:55:14.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:57:14.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T01:59:14.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:01:15.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:03:15.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:05:15.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:07:15.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:09:15.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:11:16.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:13:16.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:15:16.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-25T02:15:16.524 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1