2024-04-10T20:41:44.116 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-10T20:41:44.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:41:44.331 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2501f8c10>, signals=[15]) 2024-04-10T20:41:44.332 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging 2024-04-10T20:41:44.332 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T20:41:44.332 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-10T20:41:44.362 INFO:teuthology.lock.ops:Start node 'smithi040.front.sepia.ceph.com' reimaging 2024-04-10T20:41:44.363 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T20:41:44.363 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-10T20:41:44.412 INFO:teuthology.lock.ops:Start node 'smithi103.front.sepia.ceph.com' reimaging 2024-04-10T20:41:44.412 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T20:41:44.412 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-04-10T20:41:44.532 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T20:41:44.562 DEBUG:teuthology.provision.fog.smithi040:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T20:41:44.591 DEBUG:teuthology.provision.fog.smithi103:Requesting image smithi_centos_9.stream (ID 10) 2024-04-10T20:41:44.605 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream 2024-04-10T20:41:44.619 INFO:teuthology.provision.fog.smithi040:Scheduling deploy of centos 9.stream 2024-04-10T20:41:44.668 INFO:teuthology.provision.fog.smithi103:Scheduling deploy of centos 9.stream 2024-04-10T20:41:45.024 INFO:teuthology.orchestra.console.smithi028:Power off 2024-04-10T20:41:45.024 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T20:41:45.038 INFO:teuthology.orchestra.console.smithi103:Power off 2024-04-10T20:41:45.038 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T20:41:45.050 INFO:teuthology.orchestra.console.smithi040:Power off 2024-04-10T20:41:45.051 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T20:41:45.058 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2024-04-10T20:41:45.058 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:45.070 DEBUG:teuthology.orchestra.console.smithi103:power off output: Chassis Power Control: Down/Off 2024-04-10T20:41:45.070 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:45.098 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-04-10T20:41:45.099 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:45.107 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-10T20:41:45.117 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-04-10T20:41:45.131 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-10T20:41:45.208 INFO:teuthology.orchestra.console.smithi028:Power off completed 2024-04-10T20:41:45.218 INFO:teuthology.orchestra.console.smithi103:Power off completed 2024-04-10T20:41:45.231 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-04-10T20:41:45.310 INFO:teuthology.orchestra.console.smithi028:Power on 2024-04-10T20:41:45.310 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T20:41:45.319 INFO:teuthology.orchestra.console.smithi103:Power on 2024-04-10T20:41:45.319 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T20:41:45.332 INFO:teuthology.orchestra.console.smithi040:Power on 2024-04-10T20:41:45.332 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T20:41:45.343 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On 2024-04-10T20:41:45.343 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:45.351 DEBUG:teuthology.orchestra.console.smithi103:power on output: Chassis Power Control: Up/On 2024-04-10T20:41:45.352 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:45.365 DEBUG:teuthology.orchestra.console.smithi040:power on output: Chassis Power Control: Up/On 2024-04-10T20:41:45.365 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:45.377 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-10T20:41:45.396 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-10T20:41:45.400 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-04-10T20:41:49.378 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:49.397 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:49.404 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:49.487 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-04-10T20:41:49.506 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-10T20:41:49.513 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is off 2024-04-10T20:41:49.588 INFO:teuthology.orchestra.console.smithi028:Power on completed 2024-04-10T20:41:49.607 INFO:teuthology.orchestra.console.smithi040:Power on completed 2024-04-10T20:41:49.689 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish 2024-04-10T20:41:49.707 INFO:teuthology.provision.fog.smithi040:Waiting for deploy to finish 2024-04-10T20:41:53.518 DEBUG:teuthology.orchestra.console.smithi103:pexpect command: ipmitool -H smithi103.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:41:53.626 DEBUG:teuthology.orchestra.console.smithi103:check power output: Chassis Power is on 2024-04-10T20:41:53.727 INFO:teuthology.orchestra.console.smithi103:Power on completed 2024-04-10T20:41:53.827 INFO:teuthology.provision.fog.smithi103:Waiting for deploy to finish 2024-04-10T20:44:06.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:22.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:25.502 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-10T20:44:31.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:34.590 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-10T20:44:40.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:40.627 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-10T20:44:43.678 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-10T20:44:46.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:49.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:49.696 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-10T20:44:52.766 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-10T20:44:55.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:58.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:44:58.783 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-10T20:45:04.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:45:07.872 WARNING:teuthology.provision.fog.smithi040:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-10T20:45:13.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:45:58.786 WARNING:teuthology.provision.fog.smithi028:timed out 2024-04-10T20:46:04.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:46:05.036 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T20:46:05.036 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T20:46:05.349 INFO:teuthology.provision.fog.smithi028:Node is ready 2024-04-10T20:46:05.350 DEBUG:teuthology.orchestra.run.smithi028:> hostname 2024-04-10T20:46:05.364 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com 2024-04-10T20:46:05.364 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts 2024-04-10T20:46:05.420 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028 2024-04-10T20:46:05.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2024-04-10T20:46:05.530 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts 2024-04-10T20:46:05.561 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts 2024-04-10T20:46:05.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname 2024-04-10T20:46:05.703 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2024-04-10T20:46:05.773 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-10T20:46:05.827 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-04-10T20:46:05.827 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-04-10T20:46:05.827 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-04-10T20:46:05.827 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:46:05.827 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T20:46:05.828 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:46:05.829 INFO:teuthology.provision.fog.smithi028:Deploy complete! 2024-04-10T20:46:05.830 DEBUG:teuthology.parallel:result is None 2024-04-10T20:46:13.906 WARNING:teuthology.provision.fog.smithi040:timed out 2024-04-10T20:46:19.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:46:20.174 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T20:46:20.174 DEBUG:teuthology.orchestra.run.smithi040:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T20:46:20.526 INFO:teuthology.provision.fog.smithi040:Node is ready 2024-04-10T20:46:20.526 DEBUG:teuthology.orchestra.run.smithi040:> hostname 2024-04-10T20:46:20.542 INFO:teuthology.orchestra.run.smithi040.stdout:smithi040.front.sepia.ceph.com 2024-04-10T20:46:20.542 DEBUG:teuthology.orchestra.run.smithi040:> grep smithi040.front.sepia.ceph.com /etc/hosts 2024-04-10T20:46:20.597 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.15.40 smithi040.front.sepia.ceph.com smithi040 2024-04-10T20:46:20.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-10T20:46:20.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hosts 2024-04-10T20:46:20.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/172.21.15.40/172.21.15.40/g' /etc/hosts 2024-04-10T20:46:20.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i -e 's/smithi040.front.sepia.ceph.com/smithi040/g' /etc/hostname 2024-04-10T20:46:20.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo hostname smithi040 2024-04-10T20:46:20.954 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-10T20:46:21.009 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:46:21.010 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:46:21.011 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T20:46:21.011 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:46:21.011 INFO:teuthology.provision.fog.smithi040:Deploy complete! 2024-04-10T20:46:21.011 DEBUG:teuthology.parallel:result is None 2024-04-10T20:46:43.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:46:46.238 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:46:52.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:46:55.326 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:01.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:47:04.414 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:10.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:47:13.502 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:19.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:47:22.590 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:28.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:47:31.678 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:37.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:47:40.766 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:46.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:47:49.855 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:47:55.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:06.174 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:48:12.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:15.262 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:48:21.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:24.350 WARNING:teuthology.provision.fog.smithi103:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-04-10T20:48:30.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:32.964 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T20:48:32.964 DEBUG:teuthology.orchestra.run.smithi103:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T20:48:53.315 INFO:teuthology.provision.fog.smithi103:Node is ready 2024-04-10T20:48:53.315 DEBUG:teuthology.orchestra.run.smithi103:> hostname 2024-04-10T20:48:53.333 INFO:teuthology.orchestra.run.smithi103.stdout:smithi046 2024-04-10T20:48:53.334 DEBUG:teuthology.orchestra.run.smithi103:> grep smithi046 /etc/hosts 2024-04-10T20:48:53.391 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-10T20:48:53.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-04-10T20:48:53.532 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi046/smithi103/g' /etc/hosts 2024-04-10T20:48:53.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/172.21.15.46/172.21.15.103/g' /etc/hosts 2024-04-10T20:48:53.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i -e 's/smithi046/smithi103/g' /etc/hostname 2024-04-10T20:48:53.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname smithi103 2024-04-10T20:48:53.770 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-04-10T20:48:53.825 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T20:48:53.826 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:48:53.826 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:48:53.826 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T20:48:53.826 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:48:53.826 INFO:teuthology.provision.fog.smithi103:Deploy complete! 2024-04-10T20:48:53.827 DEBUG:teuthology.parallel:result is None 2024-04-10T20:48:54.265 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com 2024-04-10T20:48:54.266 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T20:48:54.297 INFO:teuthology.lock.ops:Checking smithi040.front.sepia.ceph.com 2024-04-10T20:48:54.297 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T20:48:54.330 INFO:teuthology.lock.ops:Checking smithi103.front.sepia.ceph.com 2024-04-10T20:48:54.330 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T20:48:54.365 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server 2024-04-10T20:48:54.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-10T20:48:54.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:54.482 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-04-10T20:48:54.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-10T20:48:54.665 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-04-10T20:48:54.720 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-04-10T20:48:54.720 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:48:54.775 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:48:54.776 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T20:48:54.776 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:48:54.776 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-10T20:48:54.806 INFO:teuthology.lock.ops:Updating [smithi040.front.sepia.ceph.com]: set os type and version on server 2024-04-10T20:48:54.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-10T20:48:54.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:54.920 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-10T20:48:55.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-10T20:48:55.101 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-10T20:48:55.156 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-10T20:48:55.157 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-10T20:48:55.211 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-10T20:48:55.211 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T20:48:55.212 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:48:55.213 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-10T20:48:55.247 INFO:teuthology.lock.ops:Updating [smithi103.front.sepia.ceph.com]: set os type and version on server 2024-04-10T20:48:55.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-04-10T20:48:55.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:48:55.347 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-04-10T20:48:55.421 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-04-10T20:48:55.421 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-04-10T20:48:55.475 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-04-10T20:48:55.476 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-04-10T20:48:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-04-10T20:48:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-04-10T20:48:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-04-10T20:48:55.530 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-10T20:48:55.531 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:48:55.531 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-04-10T20:48:55.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:48:55.658 INFO:teuthology.dispatcher.supervisor:Running job 7651211 2024-04-10T20:48:55.658 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651211 --name yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream_runc agent/on mon_election/connectivity task/test_set_mon_crush_locations} -- /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651211/orig.config.yaml 2024-04-10T20:48:55.660 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651211 2024-04-10T20:48:55.661 INFO:teuthology.dispatcher.supervisor:Job PID: 3358638 2024-04-10T20:48:55.661 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-10T20:50:55.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:52:55.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:52:56.005 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1