2024-04-18T22:48:09.739 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T22:48:09.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T22:48:09.916 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f19354b6c10>, signals=[15]) 2024-04-18T22:48:09.917 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-04-18T22:48:09.917 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T22:48:09.917 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-18T22:48:09.935 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-04-18T22:48:09.936 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T22:48:09.936 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-18T22:48:09.960 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2024-04-18T22:48:09.960 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T22:48:09.961 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-18T22:48:10.053 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T22:48:10.084 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T22:48:10.095 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T22:48:10.100 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 9.stream 2024-04-18T22:48:10.136 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2024-04-18T22:48:10.159 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2024-04-18T22:48:10.633 INFO:teuthology.orchestra.console.smithi084:Power off 2024-04-18T22:48:10.633 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T22:48:10.647 INFO:teuthology.orchestra.console.smithi161:Power off 2024-04-18T22:48:10.647 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T22:48:10.655 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-04-18T22:48:10.657 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:10.674 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-04-18T22:48:10.674 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:10.684 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-18T22:48:10.697 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-18T22:48:10.698 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T22:48:10.706 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-18T22:48:10.718 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-18T22:48:10.719 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:10.739 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-18T22:48:10.785 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-04-18T22:48:10.807 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-04-18T22:48:10.840 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-18T22:48:10.886 INFO:teuthology.orchestra.console.smithi084:Power on 2024-04-18T22:48:10.886 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T22:48:10.908 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-04-18T22:48:10.909 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:10.916 INFO:teuthology.orchestra.console.smithi161:Power on 2024-04-18T22:48:10.916 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T22:48:10.935 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-18T22:48:10.937 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-04-18T22:48:10.937 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:10.944 INFO:teuthology.orchestra.console.smithi179:Power on 2024-04-18T22:48:10.944 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T22:48:10.961 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-18T22:48:10.967 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2024-04-18T22:48:10.967 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:10.990 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-18T22:48:14.938 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:14.962 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:14.991 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:15.049 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-04-18T22:48:15.071 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-18T22:48:15.099 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-18T22:48:19.050 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:19.072 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:19.101 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T22:48:19.161 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-04-18T22:48:19.184 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-04-18T22:48:19.210 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-18T22:48:19.262 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-04-18T22:48:19.285 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-04-18T22:48:19.311 INFO:teuthology.orchestra.console.smithi179:Power on completed 2024-04-18T22:48:19.363 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-04-18T22:48:19.385 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-04-18T22:48:19.412 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2024-04-18T22:51:37.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:51:40.190 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-18T22:51:46.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:51:49.246 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-18T22:51:55.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:51:58.306 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-18T22:52:04.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:52:07.394 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-18T22:52:07.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:52:07.775 ERROR:teuthology.orchestra.connection:Error authenticating with smithi179.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T22:52:13.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:52:16.446 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-18T22:52:22.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:52:25.502 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-04-18T22:52:31.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:11.778 WARNING:teuthology.provision.fog.smithi179:timed out 2024-04-18T22:53:17.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:20.830 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-18T22:53:26.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:29.886 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-18T22:53:31.506 WARNING:teuthology.provision.fog.smithi084:timed out 2024-04-18T22:53:35.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:37.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:37.750 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T22:53:37.751 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T22:53:38.095 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-04-18T22:53:38.096 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-04-18T22:53:38.110 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-04-18T22:53:38.110 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-04-18T22:53:38.165 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-04-18T22:53:38.165 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-04-18T22:53:38.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:38.268 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-04-18T22:53:38.296 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-04-18T22:53:38.363 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-04-18T22:53:38.430 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-04-18T22:53:38.496 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T22:53:38.551 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T22:53:38.552 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-04-18T22:53:38.553 DEBUG:teuthology.parallel:result is None 2024-04-18T22:53:38.942 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-18T22:53:41.246 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:53:44.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:47.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:48.062 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-18T22:53:50.302 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:53:54.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:54.408 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T22:53:54.408 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T22:53:56.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:53:59.358 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:54:05.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:54:08.414 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:54:09.885 INFO:teuthology.provision.fog.smithi179:Node is ready 2024-04-18T22:54:09.885 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2024-04-18T22:54:09.906 INFO:teuthology.orchestra.run.smithi179.stdout:smithi046 2024-04-18T22:54:09.906 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi046 /etc/hosts 2024-04-18T22:54:09.963 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-04-18T22:54:09.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-18T22:54:10.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi046/smithi179/g' /etc/hosts 2024-04-18T22:54:10.139 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.46/172.21.15.179/g' /etc/hosts 2024-04-18T22:54:10.208 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi046/smithi179/g' /etc/hostname 2024-04-18T22:54:10.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2024-04-18T22:54:10.345 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T22:54:10.400 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T22:54:10.401 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2024-04-18T22:54:10.401 DEBUG:teuthology.parallel:result is None 2024-04-18T22:54:14.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:54:17.471 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:54:23.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:54:26.530 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:54:32.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:54:35.586 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-18T22:54:41.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:55:41.590 WARNING:teuthology.provision.fog.smithi161:timed out 2024-04-18T22:55:47.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:55:47.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T22:55:47.836 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T22:55:48.180 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-04-18T22:55:48.180 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-04-18T22:55:48.195 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-04-18T22:55:48.195 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-04-18T22:55:48.256 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-04-18T22:55:48.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-18T22:55:48.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-04-18T22:55:48.413 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-04-18T22:55:48.484 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-04-18T22:55:48.553 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-18T22:55:48.622 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T22:55:48.681 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T22:55:48.682 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T22:55:48.682 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-04-18T22:55:48.683 DEBUG:teuthology.parallel:result is None 2024-04-18T22:55:48.893 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-04-18T22:55:48.893 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T22:55:48.916 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-04-18T22:55:48.916 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T22:55:48.932 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2024-04-18T22:55:48.932 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T22:55:48.950 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-04-18T22:55:48.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-18T22:55:48.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:55:49.039 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-18T22:55:49.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-18T22:55:49.204 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-04-18T22:55:49.258 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-04-18T22:55:49.259 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-18T22:55:49.313 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T22:55:49.314 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T22:55:49.315 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T22:55:49.315 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-18T22:55:49.341 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-04-18T22:55:49.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-18T22:55:49.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:55:49.429 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-04-18T22:55:49.501 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-18T22:55:49.501 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-04-18T22:55:49.559 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-04-18T22:55:49.559 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-18T22:55:49.616 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-18T22:55:49.616 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T22:55:49.617 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T22:55:49.618 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-18T22:55:49.632 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2024-04-18T22:55:49.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-18T22:55:49.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T22:55:49.719 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-18T22:55:49.791 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-18T22:55:49.791 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-18T22:55:49.847 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-18T22:55:49.847 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2024-04-18T22:55:49.903 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T22:55:49.904 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2024-04-18T22:55:49.904 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T22:55:49.904 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T22:55:49.904 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T22:55:49.904 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-18T22:55:49.924 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T22:55:50.009 INFO:teuthology.dispatcher.supervisor:Running job 7662682 2024-04-18T22:55:50.009 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662682 --name teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi --description rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_recovery} -- /home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662682/orig.config.yaml 2024-04-18T22:55:50.012 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-18_21:00:02-rados-squid-distro-default-smithi/7662682 2024-04-18T22:55:50.012 INFO:teuthology.dispatcher.supervisor:Job PID: 1890610 2024-04-18T22:55:50.012 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T22:57:50.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T22:59:50.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:01:50.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:03:50.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:03:50.305 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-04-18T23:03:50.468 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi084 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663020 2024-04-18T23:03:50.469 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi161 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663021 2024-04-18T23:03:50.469 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7663020