2024-04-18T23:03:33.025 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T23:03:33.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:03:33.209 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdcf4c11c10>, signals=[15]) 2024-04-18T23:03:33.210 INFO:teuthology.lock.ops:Start node 'smithi018.front.sepia.ceph.com' reimaging 2024-04-18T23:03:33.210 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:03:33.210 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-04-18T23:03:33.231 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2024-04-18T23:03:33.231 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:03:33.232 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-18T23:03:33.256 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2024-04-18T23:03:33.256 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T23:03:33.256 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-18T23:03:33.352 DEBUG:teuthology.provision.fog.smithi018:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T23:03:33.383 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T23:03:33.389 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2024-04-18T23:03:33.395 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 9.stream 2024-04-18T23:03:33.441 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2024-04-18T23:03:33.444 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream 2024-04-18T23:03:33.689 INFO:teuthology.orchestra.console.smithi018:Power off 2024-04-18T23:03:33.689 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:03:33.704 INFO:teuthology.orchestra.console.smithi059:Power off 2024-04-18T23:03:33.704 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:03:33.715 DEBUG:teuthology.orchestra.console.smithi018:power off output: Chassis Power Control: Down/Off 2024-04-18T23:03:33.716 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:33.727 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2024-04-18T23:03:33.727 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:33.740 INFO:teuthology.orchestra.console.smithi167:Power off 2024-04-18T23:03:33.741 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T23:03:33.749 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-04-18T23:03:33.751 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-18T23:03:33.761 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-04-18T23:03:33.761 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:33.781 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-04-18T23:03:33.850 INFO:teuthology.orchestra.console.smithi018:Power off completed 2024-04-18T23:03:33.884 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-04-18T23:03:33.951 INFO:teuthology.orchestra.console.smithi018:Power on 2024-04-18T23:03:33.951 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:03:33.980 DEBUG:teuthology.orchestra.console.smithi018:power on output: Chassis Power Control: Up/On 2024-04-18T23:03:33.980 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:33.989 INFO:teuthology.orchestra.console.smithi167:Power on 2024-04-18T23:03:33.990 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:03:34.002 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is off 2024-04-18T23:03:34.011 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2024-04-18T23:03:34.012 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:34.032 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-04-18T23:03:37.756 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:37.864 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-18T23:03:37.965 INFO:teuthology.orchestra.console.smithi059:Power off completed 2024-04-18T23:03:38.003 DEBUG:teuthology.orchestra.console.smithi018:pexpect command: ipmitool -H smithi018.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:38.033 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:38.066 INFO:teuthology.orchestra.console.smithi059:Power on 2024-04-18T23:03:38.067 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T23:03:38.088 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2024-04-18T23:03:38.088 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:38.110 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-18T23:03:38.112 DEBUG:teuthology.orchestra.console.smithi018:check power output: Chassis Power is on 2024-04-18T23:03:38.143 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-04-18T23:03:38.213 INFO:teuthology.orchestra.console.smithi018:Power on completed 2024-04-18T23:03:38.314 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish 2024-04-18T23:03:42.114 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:42.143 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:42.225 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2024-04-18T23:03:42.252 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-04-18T23:03:42.352 INFO:teuthology.orchestra.console.smithi167:Power on completed 2024-04-18T23:03:42.453 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2024-04-18T23:03:46.230 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T23:03:46.338 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2024-04-18T23:03:46.439 INFO:teuthology.orchestra.console.smithi059:Power on completed 2024-04-18T23:03:46.540 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2024-04-18T23:06:03.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:06:03.612 ERROR:teuthology.orchestra.connection:Error authenticating with smithi059.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-18T23:06:10.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:06:13.502 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-18T23:06:19.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:06:22.558 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-18T23:06:28.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:06:31.614 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-18T23:06:37.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:06:40.670 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-18T23:06:46.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:06:49.726 WARNING:teuthology.provision.fog.smithi018:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-04-18T23:06:55.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:07:07.615 WARNING:teuthology.provision.fog.smithi059:timed out 2024-04-18T23:07:13.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:07:31.998 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-18T23:07:38.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:07:45.282 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T23:07:45.283 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T23:07:55.731 WARNING:teuthology.provision.fog.smithi018:timed out 2024-04-18T23:08:01.548 INFO:teuthology.provision.fog.smithi059:Node is ready 2024-04-18T23:08:01.548 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2024-04-18T23:08:01.567 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2024-04-18T23:08:01.567 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2024-04-18T23:08:01.624 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2024-04-18T23:08:01.624 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-04-18T23:08:01.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:08:01.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2024-04-18T23:08:01.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2024-04-18T23:08:01.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2024-04-18T23:08:01.971 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2024-04-18T23:08:02.042 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-18T23:08:02.060 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T23:08:02.060 DEBUG:teuthology.orchestra.run.smithi018:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T23:08:02.098 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-04-18T23:08:02.099 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-04-18T23:08:02.099 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T23:08:02.099 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:08:02.099 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:08:02.099 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T23:08:02.099 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:08:02.099 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2024-04-18T23:08:02.101 DEBUG:teuthology.parallel:result is None 2024-04-18T23:08:02.385 INFO:teuthology.provision.fog.smithi018:Node is ready 2024-04-18T23:08:02.385 DEBUG:teuthology.orchestra.run.smithi018:> hostname 2024-04-18T23:08:02.399 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com 2024-04-18T23:08:02.400 DEBUG:teuthology.orchestra.run.smithi018:> grep smithi018.front.sepia.ceph.com /etc/hosts 2024-04-18T23:08:02.455 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018 2024-04-18T23:08:02.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2024-04-18T23:08:02.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hosts 2024-04-18T23:08:02.609 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/172.21.15.18/172.21.15.18/g' /etc/hosts 2024-04-18T23:08:02.679 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i -e 's/smithi018.front.sepia.ceph.com/smithi018/g' /etc/hostname 2024-04-18T23:08:02.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname smithi018 2024-04-18T23:08:02.821 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T23:08:02.876 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:08:02.877 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:08:02.877 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T23:08:02.877 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:08:02.877 INFO:teuthology.provision.fog.smithi018:Deploy complete! 2024-04-18T23:08:02.877 DEBUG:teuthology.parallel:result is None 2024-04-18T23:09:01.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:04.222 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:09:10.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:13.278 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:09:19.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:22.339 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:09:28.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:31.390 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:09:37.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:40.446 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:09:46.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:49.506 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:09:55.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:09:58.558 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:10:04.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:10:07.614 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-18T23:10:13.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:11:13.618 WARNING:teuthology.provision.fog.smithi167:timed out 2024-04-18T23:11:19.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:11:19.825 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T23:11:19.825 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T23:11:20.159 INFO:teuthology.provision.fog.smithi167:Node is ready 2024-04-18T23:11:20.159 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2024-04-18T23:11:20.173 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2024-04-18T23:11:20.173 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2024-04-18T23:11:20.228 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2024-04-18T23:11:20.228 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-04-18T23:11:20.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2024-04-18T23:11:20.360 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2024-04-18T23:11:20.427 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2024-04-18T23:11:20.494 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-04-18T23:11:20.561 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-04-18T23:11:20.616 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-04-18T23:11:20.617 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T23:11:20.617 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:11:20.617 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:11:20.617 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T23:11:20.617 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:11:20.617 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2024-04-18T23:11:20.617 DEBUG:teuthology.parallel:result is None 2024-04-18T23:11:20.837 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com 2024-04-18T23:11:20.838 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T23:11:20.865 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2024-04-18T23:11:20.865 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T23:11:20.881 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2024-04-18T23:11:20.881 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T23:11:20.899 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server 2024-04-18T23:11:20.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-18T23:11:20.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:11:21.000 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-18T23:11:21.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-18T23:11:21.181 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-04-18T23:11:21.236 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-04-18T23:11:21.237 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-04-18T23:11:21.291 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T23:11:21.292 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:11:21.293 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-04-18T23:11:21.315 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2024-04-18T23:11:21.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-18T23:11:21.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:11:21.415 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-18T23:11:21.604 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-18T23:11:21.605 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-04-18T23:11:21.659 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-04-18T23:11:21.660 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:11:21.715 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:11:21.716 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T23:11:21.716 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:11:21.716 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-18T23:11:21.740 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2024-04-18T23:11:21.740 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-18T23:11:21.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T23:11:21.828 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-04-18T23:11:21.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-18T23:11:21.892 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-04-18T23:11:21.947 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-04-18T23:11:21.947 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-18T23:11:22.002 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-18T23:11:22.003 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-18T23:11:22.004 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-18T23:11:22.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:11:22.108 INFO:teuthology.dispatcher.supervisor:Running job 7662996 2024-04-18T23:11:22.108 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7662996 --name yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_9.stream agent/off mon_election/classic task/test_rgw_multisite} -- /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7662996/orig.config.yaml 2024-04-18T23:11:22.111 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-18_22:49:05-rados-wip-yuri5-testing-2024-04-17-1400-distro-default-smithi/7662996 2024-04-18T23:11:22.111 INFO:teuthology.dispatcher.supervisor:Job PID: 1989538 2024-04-18T23:11:22.111 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T23:13:22.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:15:22.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:17:22.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:19:22.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:21:22.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T23:21:22.467 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1