2024-04-08T03:45:20.036 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-08T03:45:20.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:45:20.259 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f853d2aec10>, signals=[15]) 2024-04-08T03:45:20.260 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2024-04-08T03:45:20.260 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T03:45:20.260 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-08T03:45:20.291 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2024-04-08T03:45:20.291 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T03:45:20.291 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-04-08T03:45:20.341 INFO:teuthology.lock.ops:Start node 'smithi171.front.sepia.ceph.com' reimaging 2024-04-08T03:45:20.341 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T03:45:20.341 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-04-08T03:45:20.481 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T03:45:20.542 DEBUG:teuthology.provision.fog.smithi171:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T03:45:20.553 DEBUG:teuthology.provision.fog.smithi083:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T03:45:20.564 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 8.stream 2024-04-08T03:45:20.612 INFO:teuthology.provision.fog.smithi171:Scheduling deploy of centos 8.stream 2024-04-08T03:45:20.624 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of centos 8.stream 2024-04-08T03:45:20.900 INFO:teuthology.orchestra.console.smithi040:Power off 2024-04-08T03:45:20.900 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T03:45:20.947 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-04-08T03:45:20.948 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:20.966 INFO:teuthology.orchestra.console.smithi171:Power off 2024-04-08T03:45:20.966 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T03:45:20.978 INFO:teuthology.orchestra.console.smithi083:Power off 2024-04-08T03:45:20.979 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T03:45:20.995 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-08T03:45:21.016 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-04-08T03:45:21.016 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:21.024 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2024-04-08T03:45:21.024 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:21.074 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-08T03:45:21.074 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-08T03:45:24.999 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:25.075 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:25.082 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:25.109 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-08T03:45:25.184 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-08T03:45:25.189 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-08T03:45:29.110 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:29.185 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:29.193 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:29.219 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-08T03:45:29.294 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-08T03:45:29.301 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-08T03:45:33.222 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:33.296 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:33.303 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:33.332 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-08T03:45:33.405 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-04-08T03:45:33.412 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-04-08T03:45:33.433 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-04-08T03:45:33.506 INFO:teuthology.orchestra.console.smithi083:Power off completed 2024-04-08T03:45:33.512 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-04-08T03:45:33.535 INFO:teuthology.orchestra.console.smithi040:Power on 2024-04-08T03:45:33.535 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T03:45:33.583 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2024-04-08T03:45:33.583 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:33.608 INFO:teuthology.orchestra.console.smithi083:Power on 2024-04-08T03:45:33.608 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T03:45:33.615 INFO:teuthology.orchestra.console.smithi171:Power on 2024-04-08T03:45:33.616 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T03:45:33.623 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-08T03:45:33.638 DEBUG:teuthology.orchestra.console.smithi083:power on output: Chassis Power Control: Up/On 2024-04-08T03:45:33.639 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:33.647 DEBUG:teuthology.orchestra.console.smithi171:power on output: Chassis Power Control: Up/On 2024-04-08T03:45:33.647 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:33.669 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-04-08T03:45:33.677 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-04-08T03:45:37.626 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:37.669 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:37.678 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:37.737 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-08T03:45:37.778 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-04-08T03:45:37.786 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-04-08T03:45:37.839 INFO:teuthology.orchestra.console.smithi040:Power on completed 2024-04-08T03:45:37.879 INFO:teuthology.orchestra.console.smithi083:Power on completed 2024-04-08T03:45:37.940 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2024-04-08T03:45:37.980 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2024-04-08T03:45:41.790 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T03:45:41.900 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-08T03:45:42.001 INFO:teuthology.orchestra.console.smithi171:Power on completed 2024-04-08T03:45:42.102 INFO:teuthology.provision.fog.smithi171:Waiting for deploy to finish 2024-04-08T03:48:23.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:27.006 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-08T03:48:27.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:31.006 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:48:33.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:36.062 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-08T03:48:37.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:40.065 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:48:42.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:45.118 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-08T03:48:46.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:49.154 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:48:51.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:54.175 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-08T03:48:55.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:48:58.238 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:49:00.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:03.230 WARNING:teuthology.provision.fog.smithi083:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-04-08T03:49:04.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:07.298 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:49:09.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:09.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:12.318 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-08T03:49:13.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:16.354 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:49:18.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:21.374 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-08T03:49:22.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:25.406 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:49:27.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:30.430 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-08T03:49:31.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:34.462 WARNING:teuthology.provision.fog.smithi171:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-08T03:49:36.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:39.490 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-08T03:49:40.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:45.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:48.578 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-08T03:49:54.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:49:57.662 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-08T03:50:03.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:50:09.240 WARNING:teuthology.provision.fog.smithi083:timed out 2024-04-08T03:50:15.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:50:15.467 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T03:50:15.468 DEBUG:teuthology.orchestra.run.smithi083:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T03:50:15.716 INFO:teuthology.provision.fog.smithi083:Node is ready 2024-04-08T03:50:15.716 DEBUG:teuthology.orchestra.run.smithi083:> hostname 2024-04-08T03:50:15.735 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2024-04-08T03:50:15.735 DEBUG:teuthology.orchestra.run.smithi083:> grep smithi083.front.sepia.ceph.com /etc/hosts 2024-04-08T03:50:15.794 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2024-04-08T03:50:15.794 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2024-04-08T03:50:15.884 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hosts 2024-04-08T03:50:15.913 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/172.21.15.83/172.21.15.83/g' /etc/hosts 2024-04-08T03:50:15.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i -e 's/smithi083.front.sepia.ceph.com/smithi083/g' /etc/hostname 2024-04-08T03:50:16.048 DEBUG:teuthology.orchestra.run.smithi083:> sudo hostname smithi083 2024-04-08T03:50:16.115 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T03:50:16.174 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-04-08T03:50:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T03:50:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-04-08T03:50:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T03:50:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T03:50:16.175 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T03:50:16.176 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2024-04-08T03:50:16.177 DEBUG:teuthology.parallel:result is None 2024-04-08T03:50:40.491 WARNING:teuthology.provision.fog.smithi171:timed out 2024-04-08T03:50:46.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:50:46.743 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T03:50:46.743 DEBUG:teuthology.orchestra.run.smithi171:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T03:50:47.045 INFO:teuthology.provision.fog.smithi171:Node is ready 2024-04-08T03:50:47.045 DEBUG:teuthology.orchestra.run.smithi171:> hostname 2024-04-08T03:50:47.065 INFO:teuthology.orchestra.run.smithi171.stdout:smithi171.front.sepia.ceph.com 2024-04-08T03:50:47.065 DEBUG:teuthology.orchestra.run.smithi171:> grep smithi171.front.sepia.ceph.com /etc/hosts 2024-04-08T03:50:47.124 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.15.171 smithi171.front.sepia.ceph.com smithi171 2024-04-08T03:50:47.125 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2024-04-08T03:50:47.216 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hosts 2024-04-08T03:50:47.246 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/172.21.15.171/172.21.15.171/g' /etc/hosts 2024-04-08T03:50:47.314 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i -e 's/smithi171.front.sepia.ceph.com/smithi171/g' /etc/hostname 2024-04-08T03:50:47.382 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname smithi171 2024-04-08T03:50:47.449 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T03:50:47.507 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-04-08T03:50:47.508 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T03:50:47.508 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-04-08T03:50:47.508 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T03:50:47.508 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T03:50:47.508 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T03:50:47.508 INFO:teuthology.provision.fog.smithi171:Deploy complete! 2024-04-08T03:50:47.509 DEBUG:teuthology.parallel:result is None 2024-04-08T03:51:03.679 WARNING:teuthology.provision.fog.smithi040:timed out 2024-04-08T03:51:09.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:51:09.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T03:51:09.964 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T03:51:10.222 INFO:teuthology.provision.fog.smithi040:Node is ready 2024-04-08T03:51:10.222 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2024-04-08T03:51:10.245 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2024-04-08T03:51:10.245 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2024-04-08T03:51:10.305 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2024-04-08T03:51:10.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-08T03:51:10.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2024-04-08T03:51:10.463 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2024-04-08T03:51:10.534 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2024-04-08T03:51:10.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-08T03:51:10.676 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-08T03:51:10.735 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T03:51:10.736 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T03:51:10.737 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2024-04-08T03:51:10.737 DEBUG:teuthology.parallel:result is None 2024-04-08T03:51:10.943 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2024-04-08T03:51:10.944 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T03:51:10.968 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2024-04-08T03:51:10.968 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T03:51:10.993 INFO:teuthology.lock.ops:Checking smithi171.front.sepia.ceph.com 2024-04-08T03:51:10.993 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T03:51:11.011 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2024-04-08T03:51:11.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-08T03:51:11.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:51:11.085 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-08T03:51:11.159 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-08T03:51:11.159 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-08T03:51:11.220 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-08T03:51:11.220 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-08T03:51:11.280 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-08T03:51:11.280 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2024-04-08T03:51:11.280 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-08T03:51:11.280 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-08T03:51:11.281 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2024-04-08T03:51:11.281 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2024-04-08T03:51:11.281 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T03:51:11.281 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-08T03:51:11.281 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T03:51:11.282 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-08T03:51:11.282 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T03:51:11.282 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T03:51:11.282 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T03:51:11.283 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-08T03:51:11.319 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2024-04-08T03:51:11.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-04-08T03:51:11.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:51:11.404 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-04-08T03:51:11.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-04-08T03:51:11.542 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-04-08T03:51:11.600 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-04-08T03:51:11.600 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-04-08T03:51:11.658 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T03:51:11.659 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T03:51:11.660 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-04-08T03:51:11.686 INFO:teuthology.lock.ops:Updating [smithi171.front.sepia.ceph.com]: set os type and version on server 2024-04-08T03:51:11.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-08T03:51:11.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T03:51:11.761 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-08T03:51:11.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-08T03:51:11.902 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-04-08T03:51:11.961 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-04-08T03:51:11.961 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8" 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8" 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2024-04-08T03:51:12.020 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T03:51:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-04-08T03:51:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T03:51:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-04-08T03:51:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T03:51:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T03:51:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T03:51:12.021 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-04-08T03:51:12.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:51:12.159 INFO:teuthology.dispatcher.supervisor:Running job 7645271 2024-04-08T03:51:12.159 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi/7645271 --name yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi/7645271/orig.config.yaml 2024-04-08T03:51:12.162 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi/7645271 2024-04-08T03:51:12.163 INFO:teuthology.dispatcher.supervisor:Job PID: 1819659 2024-04-08T03:51:12.163 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-08T03:53:12.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:55:12.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:57:12.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:59:12.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:01:12.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:03:13.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:05:13.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:07:13.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:09:13.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:11:13.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:13:13.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:15:14.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:17:14.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:19:14.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:21:14.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:23:14.743 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:25:14.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:27:15.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:29:15.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T04:29:15.495 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1