2024-02-09T16:56:39.548 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-09T16:56:39.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T16:56:39.715 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd3ad5f8c10>, signals=[15]) 2024-02-09T16:56:39.716 INFO:teuthology.lock.ops:Start node 'smithi029.front.sepia.ceph.com' reimaging 2024-02-09T16:56:39.716 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T16:56:39.716 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-02-09T16:56:39.740 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging 2024-02-09T16:56:39.740 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T16:56:39.740 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-02-09T16:56:39.764 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-02-09T16:56:39.764 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-02-09T16:56:39.764 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-09T16:56:39.851 DEBUG:teuthology.provision.fog.smithi029:Requesting image smithi_centos_8.stream (ID 3) 2024-02-09T16:56:39.865 DEBUG:teuthology.provision.fog.smithi073:Requesting image smithi_centos_8.stream (ID 3) 2024-02-09T16:56:39.897 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream 2024-02-09T16:56:39.907 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of centos 8.stream 2024-02-09T16:56:40.038 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3) 2024-02-09T16:56:40.084 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream 2024-02-09T16:56:40.149 INFO:teuthology.orchestra.console.smithi029:Power off 2024-02-09T16:56:40.149 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T16:56:40.162 INFO:teuthology.orchestra.console.smithi073:Power off 2024-02-09T16:56:40.162 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T16:56:40.170 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2024-02-09T16:56:40.170 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:40.185 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2024-02-09T16:56:40.185 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:40.197 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-02-09T16:56:40.208 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-02-09T16:56:40.299 INFO:teuthology.orchestra.console.smithi029:Power off completed 2024-02-09T16:56:40.309 INFO:teuthology.orchestra.console.smithi073:Power off completed 2024-02-09T16:56:40.320 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-09T16:56:40.321 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-09T16:56:40.344 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-09T16:56:40.344 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:40.365 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-09T16:56:40.400 INFO:teuthology.orchestra.console.smithi029:Power on 2024-02-09T16:56:40.400 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T16:56:40.410 INFO:teuthology.orchestra.console.smithi073:Power on 2024-02-09T16:56:40.410 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T16:56:40.423 DEBUG:teuthology.orchestra.console.smithi029:power on output: Chassis Power Control: Up/On 2024-02-09T16:56:40.424 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:40.433 DEBUG:teuthology.orchestra.console.smithi073:power on output: Chassis Power Control: Up/On 2024-02-09T16:56:40.433 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:40.449 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2024-02-09T16:56:40.454 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-02-09T16:56:40.466 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-09T16:56:40.567 INFO:teuthology.orchestra.console.smithi191:Power on 2024-02-09T16:56:40.567 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-09T16:56:40.589 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-02-09T16:56:40.589 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:40.610 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-09T16:56:44.451 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:44.459 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:44.561 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2024-02-09T16:56:44.567 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2024-02-09T16:56:44.611 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:44.662 INFO:teuthology.orchestra.console.smithi029:Power on completed 2024-02-09T16:56:44.723 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-09T16:56:44.763 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish 2024-02-09T16:56:48.572 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:48.680 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2024-02-09T16:56:48.724 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-09T16:56:48.781 INFO:teuthology.orchestra.console.smithi073:Power on completed 2024-02-09T16:56:48.833 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-09T16:56:48.881 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish 2024-02-09T16:56:48.934 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-02-09T16:56:49.034 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-02-09T16:59:34.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T16:59:35.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T16:59:37.948 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-02-09T16:59:38.076 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-09T16:59:43.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T16:59:44.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T16:59:47.036 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-02-09T16:59:47.132 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-09T16:59:53.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T16:59:53.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T16:59:56.092 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-02-09T16:59:56.192 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-09T17:00:00.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:02.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:02.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:03.996 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-02-09T17:00:05.148 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-02-09T17:00:05.244 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-09T17:00:10.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:11.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:11.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:13.052 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-02-09T17:00:14.204 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-02-09T17:00:14.300 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-09T17:00:19.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:20.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:20.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:22.108 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-02-09T17:00:23.260 WARNING:teuthology.provision.fog.smithi073:[Errno None] Unable to connect to port 22 on 172.21.15.73 2024-02-09T17:00:23.356 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-09T17:00:28.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:29.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:29.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:31.164 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-02-09T17:00:37.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:00:40.252 WARNING:teuthology.provision.fog.smithi029:[Errno None] Unable to connect to port 22 on 172.21.15.29 2024-02-09T17:00:46.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:29.307 WARNING:teuthology.provision.fog.smithi073:timed out 2024-02-09T17:01:29.362 WARNING:teuthology.provision.fog.smithi191:timed out 2024-02-09T17:01:35.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:35.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:35.565 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T17:01:35.566 DEBUG:teuthology.orchestra.run.smithi073:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T17:01:35.654 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T17:01:35.654 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T17:01:35.818 INFO:teuthology.provision.fog.smithi073:Node is ready 2024-02-09T17:01:35.818 DEBUG:teuthology.orchestra.run.smithi073:> hostname 2024-02-09T17:01:35.837 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073.front.sepia.ceph.com 2024-02-09T17:01:35.837 DEBUG:teuthology.orchestra.run.smithi073:> grep smithi073.front.sepia.ceph.com /etc/hosts 2024-02-09T17:01:35.896 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073 2024-02-09T17:01:35.896 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-02-09T17:01:35.905 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-02-09T17:01:35.905 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-02-09T17:01:35.925 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-02-09T17:01:35.925 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-02-09T17:01:35.985 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-02-09T17:01:35.985 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-09T17:01:35.992 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hosts 2024-02-09T17:01:36.021 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/172.21.15.73/172.21.15.73/g' /etc/hosts 2024-02-09T17:01:36.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-02-09T17:01:36.089 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i -e 's/smithi073.front.sepia.ceph.com/smithi073/g' /etc/hostname 2024-02-09T17:01:36.113 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-02-09T17:01:36.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname smithi073 2024-02-09T17:01:36.182 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-02-09T17:01:36.223 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-02-09T17:01:36.251 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-09T17:01:36.280 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-02-09T17:01:36.280 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2024-02-09T17:01:36.280 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-02-09T17:01:36.280 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-02-09T17:01:36.280 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T17:01:36.281 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T17:01:36.282 INFO:teuthology.provision.fog.smithi073:Deploy complete! 2024-02-09T17:01:36.283 DEBUG:teuthology.parallel:result is None 2024-02-09T17:01:36.318 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-09T17:01:36.376 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T17:01:36.377 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-09T17:01:36.377 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T17:01:36.377 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T17:01:36.377 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T17:01:36.377 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-02-09T17:01:36.377 DEBUG:teuthology.parallel:result is None 2024-02-09T17:01:46.269 WARNING:teuthology.provision.fog.smithi029:timed out 2024-02-09T17:01:52.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:52.553 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-09T17:01:52.553 DEBUG:teuthology.orchestra.run.smithi029:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-09T17:01:52.794 INFO:teuthology.provision.fog.smithi029:Node is ready 2024-02-09T17:01:52.794 DEBUG:teuthology.orchestra.run.smithi029:> hostname 2024-02-09T17:01:52.814 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com 2024-02-09T17:01:52.815 DEBUG:teuthology.orchestra.run.smithi029:> grep smithi029.front.sepia.ceph.com /etc/hosts 2024-02-09T17:01:52.876 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029 2024-02-09T17:01:52.876 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-02-09T17:01:53.011 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hosts 2024-02-09T17:01:53.043 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/172.21.15.29/172.21.15.29/g' /etc/hosts 2024-02-09T17:01:53.114 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i -e 's/smithi029.front.sepia.ceph.com/smithi029/g' /etc/hostname 2024-02-09T17:01:53.184 DEBUG:teuthology.orchestra.run.smithi029:> sudo hostname smithi029 2024-02-09T17:01:53.253 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-02-09T17:01:53.312 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-02-09T17:01:53.312 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2024-02-09T17:01:53.312 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-02-09T17:01:53.312 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-02-09T17:01:53.312 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T17:01:53.313 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T17:01:53.313 INFO:teuthology.provision.fog.smithi029:Deploy complete! 2024-02-09T17:01:53.314 DEBUG:teuthology.parallel:result is None 2024-02-09T17:01:53.506 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com 2024-02-09T17:01:53.506 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-09T17:01:53.527 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com 2024-02-09T17:01:53.527 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-09T17:01:53.552 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-02-09T17:01:53.552 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-09T17:01:53.570 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server 2024-02-09T17:01:53.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-02-09T17:01:53.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:53.648 DEBUG:teuthology.orchestra.run.smithi029:> true 2024-02-09T17:01:53.720 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2024-02-09T17:01:53.720 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2024-02-09T17:01:53.781 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2024-02-09T17:01:53.781 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2024-02-09T17:01:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream" 2024-02-09T17:01:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8" 2024-02-09T17:01:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos" 2024-02-09T17:01:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora" 2024-02-09T17:01:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8" 2024-02-09T17:01:53.842 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T17:01:53.843 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T17:01:53.843 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2024-02-09T17:01:53.896 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server 2024-02-09T17:01:53.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-02-09T17:01:53.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:53.971 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-02-09T17:01:54.102 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-02-09T17:01:54.103 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-02-09T17:01:54.162 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-02-09T17:01:54.162 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-02-09T17:01:54.221 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T17:01:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-02-09T17:01:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T17:01:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T17:01:54.222 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T17:01:54.222 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-02-09T17:01:54.243 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-02-09T17:01:54.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-09T17:01:54.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-09T17:01:54.317 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-02-09T17:01:54.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-09T17:01:54.455 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-02-09T17:01:54.515 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-02-09T17:01:54.515 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-09T17:01:54.574 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-09T17:01:54.575 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-09T17:01:54.575 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-09T17:01:54.575 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-09T17:01:54.575 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-09T17:01:54.575 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-09T17:01:54.575 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-09T17:01:54.575 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-09T17:01:54.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:01:54.684 INFO:teuthology.dispatcher.supervisor:Running job 7554108 2024-02-09T17:01:54.685 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-02-09_16:40:54-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi/7554108 --name lflores-2024-02-09_16:40:54-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/lflores-2024-02-09_16:40:54-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi/7554108/orig.config.yaml 2024-02-09T17:01:54.688 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-02-09_16:40:54-rados-wip-yuri2-testing-2024-02-06-1154-distro-default-smithi/7554108 2024-02-09T17:01:54.688 INFO:teuthology.dispatcher.supervisor:Job PID: 517474 2024-02-09T17:01:54.688 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-09T17:03:54.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:05:54.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:07:55.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:09:55.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:11:55.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:13:55.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:15:55.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:17:56.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:19:56.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:21:56.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:23:56.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:25:56.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:27:57.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:29:57.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:31:57.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:33:57.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:35:57.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:37:57.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:39:58.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:41:58.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:43:58.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-09T17:43:58.435 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1