2024-04-08T02:31:05.101 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-08T02:31:05.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:31:05.278 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa743929c10>, signals=[15]) 2024-04-08T02:31:05.278 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2024-04-08T02:31:05.278 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T02:31:05.279 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-08T02:31:05.307 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2024-04-08T02:31:05.308 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T02:31:05.308 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-08T02:31:05.332 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2024-04-08T02:31:05.332 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T02:31:05.332 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-04-08T02:31:05.422 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T02:31:05.425 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T02:31:05.461 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2024-04-08T02:31:05.464 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.stream 2024-04-08T02:31:05.468 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream 2024-04-08T02:31:05.505 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2024-04-08T02:31:05.692 INFO:teuthology.orchestra.console.smithi016:Power off 2024-04-08T02:31:05.692 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T02:31:05.705 INFO:teuthology.orchestra.console.smithi062:Power off 2024-04-08T02:31:05.706 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T02:31:05.716 INFO:teuthology.orchestra.console.smithi105:Power off 2024-04-08T02:31:05.716 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T02:31:05.725 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-04-08T02:31:05.725 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:05.733 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-04-08T02:31:05.734 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:05.741 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2024-04-08T02:31:05.742 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:05.749 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-08T02:31:05.758 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-08T02:31:05.763 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-08T02:31:09.754 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:09.761 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:09.768 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:09.864 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-08T02:31:09.870 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-08T02:31:09.877 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-08T02:31:13.869 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:13.876 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:13.883 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:13.979 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-08T02:31:13.984 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-08T02:31:13.991 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-04-08T02:31:14.080 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-04-08T02:31:14.085 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-04-08T02:31:14.092 INFO:teuthology.orchestra.console.smithi105:Power off completed 2024-04-08T02:31:14.181 INFO:teuthology.orchestra.console.smithi016:Power on 2024-04-08T02:31:14.181 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T02:31:14.189 INFO:teuthology.orchestra.console.smithi062:Power on 2024-04-08T02:31:14.189 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T02:31:14.196 INFO:teuthology.orchestra.console.smithi105:Power on 2024-04-08T02:31:14.197 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T02:31:14.206 DEBUG:teuthology.orchestra.console.smithi016:power on output: Chassis Power Control: Up/On 2024-04-08T02:31:14.206 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:14.214 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2024-04-08T02:31:14.215 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:14.224 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2024-04-08T02:31:14.224 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:14.234 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-08T02:31:14.236 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-08T02:31:14.246 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-04-08T02:31:18.238 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:18.245 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:18.252 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:18.347 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-08T02:31:18.354 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-04-08T02:31:18.361 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2024-04-08T02:31:22.350 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:22.358 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:22.365 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T02:31:22.460 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-08T02:31:22.467 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-04-08T02:31:22.474 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2024-04-08T02:31:22.561 INFO:teuthology.orchestra.console.smithi016:Power on completed 2024-04-08T02:31:22.568 INFO:teuthology.orchestra.console.smithi062:Power on completed 2024-04-08T02:31:22.575 INFO:teuthology.orchestra.console.smithi105:Power on completed 2024-04-08T02:31:22.662 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2024-04-08T02:31:22.668 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2024-04-08T02:31:22.676 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2024-04-08T02:33:53.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:33:53.963 ERROR:teuthology.orchestra.connection:Error authenticating with smithi016.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2024-04-08T02:34:08.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:08.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:11.614 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:34:11.650 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-08T02:34:17.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:17.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:20.670 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:34:20.706 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-08T02:34:26.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:26.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:29.726 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:34:29.762 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-08T02:34:35.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:35.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:38.782 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:34:38.818 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-08T02:34:44.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:44.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:47.838 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:34:47.870 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-08T02:34:53.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:53.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:34:56.897 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:34:56.926 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-04-08T02:34:57.966 WARNING:teuthology.provision.fog.smithi016:timed out 2024-04-08T02:35:02.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:35:02.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:35:03.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:35:05.954 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-04-08T02:35:11.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:35:38.654 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-08T02:35:43.767 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T02:35:43.768 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T02:35:44.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:35:47.714 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-08T02:35:53.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:35:54.199 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T02:35:54.199 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T02:36:02.929 WARNING:teuthology.provision.fog.smithi105:timed out 2024-04-08T02:36:08.807 INFO:teuthology.provision.fog.smithi062:Node is ready 2024-04-08T02:36:08.808 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2024-04-08T02:36:08.832 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2024-04-08T02:36:08.832 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2024-04-08T02:36:08.894 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2024-04-08T02:36:08.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2024-04-08T02:36:08.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:36:09.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2024-04-08T02:36:09.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2024-04-08T02:36:09.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2024-04-08T02:36:09.145 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T02:36:09.145 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T02:36:09.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2024-04-08T02:36:09.270 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-08T02:36:09.329 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-04-08T02:36:09.329 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2024-04-08T02:36:09.329 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-04-08T02:36:09.329 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T02:36:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T02:36:09.331 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2024-04-08T02:36:09.332 DEBUG:teuthology.parallel:result is None 2024-04-08T02:36:09.388 INFO:teuthology.provision.fog.smithi105:Node is ready 2024-04-08T02:36:09.389 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2024-04-08T02:36:09.408 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2024-04-08T02:36:09.408 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2024-04-08T02:36:09.427 INFO:teuthology.provision.fog.smithi016:Node is ready 2024-04-08T02:36:09.427 DEBUG:teuthology.orchestra.run.smithi016:> hostname 2024-04-08T02:36:09.452 INFO:teuthology.orchestra.run.smithi016.stdout:smithi193 2024-04-08T02:36:09.452 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi193 /etc/hosts 2024-04-08T02:36:09.467 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2024-04-08T02:36:09.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-04-08T02:36:09.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-08T02:36:09.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi193/smithi016/g' /etc/hostname 2024-04-08T02:36:09.582 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2024-04-08T02:36:09.611 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2024-04-08T02:36:09.680 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2024-04-08T02:36:09.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016 2024-04-08T02:36:09.712 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-08T02:36:09.749 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T02:36:09.772 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T02:36:09.773 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T02:36:09.773 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2024-04-08T02:36:09.773 DEBUG:teuthology.parallel:result is None 2024-04-08T02:36:09.817 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-04-08T02:36:09.875 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-04-08T02:36:09.875 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2024-04-08T02:36:09.875 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T02:36:09.876 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T02:36:09.876 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2024-04-08T02:36:09.877 DEBUG:teuthology.parallel:result is None 2024-04-08T02:36:10.069 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2024-04-08T02:36:10.069 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T02:36:10.097 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2024-04-08T02:36:10.097 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T02:36:10.122 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2024-04-08T02:36:10.122 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T02:36:10.140 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2024-04-08T02:36:10.140 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-08T02:36:10.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:36:10.216 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-08T02:36:10.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-08T02:36:10.288 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-08T02:36:10.349 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-08T02:36:10.349 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T02:36:10.410 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T02:36:10.411 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T02:36:10.411 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-08T02:36:10.431 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2024-04-08T02:36:10.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-08T02:36:10.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:36:10.507 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-04-08T02:36:10.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-04-08T02:36:10.586 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-04-08T02:36:10.648 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-04-08T02:36:10.648 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-04-08T02:36:10.709 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-04-08T02:36:10.710 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T02:36:10.711 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T02:36:10.711 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T02:36:10.711 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-04-08T02:36:10.730 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2024-04-08T02:36:10.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-04-08T02:36:10.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T02:36:10.801 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-04-08T02:36:10.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-04-08T02:36:10.873 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-04-08T02:36:10.932 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-04-08T02:36:10.932 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-04-08T02:36:10.992 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-04-08T02:36:10.992 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2024-04-08T02:36:10.992 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-04-08T02:36:10.992 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-04-08T02:36:10.992 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-08T02:36:10.993 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-08T02:36:10.993 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-04-08T02:36:11.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:36:11.103 INFO:teuthology.dispatcher.supervisor:Running job 7645156 2024-04-08T02:36:11.103 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi/7645156 --name yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} -- /home/teuthworker/archive/yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi/7645156/orig.config.yaml 2024-04-08T02:36:11.106 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-08_00:47:05-rados-wip-yuri-testing-2024-04-07-0902-distro-default-smithi/7645156 2024-04-08T02:36:11.106 INFO:teuthology.dispatcher.supervisor:Job PID: 1355604 2024-04-08T02:36:11.106 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-08T02:38:11.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:40:11.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:42:11.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:44:11.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:46:11.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:48:11.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:50:11.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:52:11.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:54:11.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:56:11.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T02:58:11.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:00:11.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:02:12.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:04:12.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:06:12.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:08:12.350 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T03:08:12.446 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1