2024-02-19T06:20:30.910 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T06:20:30.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:20:31.091 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f429ee29c10>, signals=[15]) 2024-02-19T06:20:31.091 INFO:teuthology.lock.ops:Start node 'smithi053.front.sepia.ceph.com' reimaging 2024-02-19T06:20:31.092 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T06:20:31.092 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-02-19T06:20:31.114 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-02-19T06:20:31.114 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T06:20:31.114 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-02-19T06:20:31.130 INFO:teuthology.lock.ops:Start node 'smithi163.front.sepia.ceph.com' reimaging 2024-02-19T06:20:31.131 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T06:20:31.131 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-02-19T06:20:31.231 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T06:20:31.238 DEBUG:teuthology.provision.fog.smithi053:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T06:20:31.260 DEBUG:teuthology.provision.fog.smithi163:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T06:20:31.268 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-02-19T06:20:31.280 INFO:teuthology.provision.fog.smithi053:Scheduling deploy of centos 9.stream 2024-02-19T06:20:31.305 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 9.stream 2024-02-19T06:20:31.688 INFO:teuthology.orchestra.console.smithi163:Power off 2024-02-19T06:20:31.688 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T06:20:31.701 INFO:teuthology.orchestra.console.smithi119:Power off 2024-02-19T06:20:31.701 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T06:20:31.712 INFO:teuthology.orchestra.console.smithi053:Power off 2024-02-19T06:20:31.712 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T06:20:31.720 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-02-19T06:20:31.720 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:31.728 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-02-19T06:20:31.729 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:31.737 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2024-02-19T06:20:31.737 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:31.745 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-02-19T06:20:31.748 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-02-19T06:20:31.758 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-02-19T06:20:31.849 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-02-19T06:20:31.950 INFO:teuthology.orchestra.console.smithi119:Power on 2024-02-19T06:20:31.950 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T06:20:31.971 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-02-19T06:20:31.971 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:31.992 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-02-19T06:20:35.749 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:35.759 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:35.858 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-02-19T06:20:35.867 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-02-19T06:20:35.993 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:36.102 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-02-19T06:20:36.202 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-02-19T06:20:36.303 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-02-19T06:20:39.860 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:39.868 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:39.970 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-02-19T06:20:39.975 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-02-19T06:20:40.071 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-02-19T06:20:40.076 INFO:teuthology.orchestra.console.smithi053:Power off completed 2024-02-19T06:20:40.172 INFO:teuthology.orchestra.console.smithi163:Power on 2024-02-19T06:20:40.172 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T06:20:40.179 INFO:teuthology.orchestra.console.smithi053:Power on 2024-02-19T06:20:40.179 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T06:20:40.193 DEBUG:teuthology.orchestra.console.smithi163:power on output: Chassis Power Control: Up/On 2024-02-19T06:20:40.193 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:40.202 DEBUG:teuthology.orchestra.console.smithi053:power on output: Chassis Power Control: Up/On 2024-02-19T06:20:40.202 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:40.217 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-02-19T06:20:40.222 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-02-19T06:20:44.220 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:44.228 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:44.331 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-02-19T06:20:44.337 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2024-02-19T06:20:44.432 INFO:teuthology.orchestra.console.smithi163:Power on completed 2024-02-19T06:20:44.533 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2024-02-19T06:20:48.341 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T06:20:48.449 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2024-02-19T06:20:48.549 INFO:teuthology.orchestra.console.smithi053:Power on completed 2024-02-19T06:20:48.650 INFO:teuthology.provision.fog.smithi053:Waiting for deploy to finish 2024-02-19T06:23:21.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:23:32.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:23:39.580 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-02-19T06:23:45.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:23:48.636 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-02-19T06:23:50.588 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T06:23:54.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:23:56.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:23:57.692 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-02-19T06:23:59.644 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T06:24:03.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:05.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:08.700 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T06:24:14.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:22.076 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-02-19T06:24:28.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:31.164 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-02-19T06:24:33.084 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T06:24:37.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:39.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:40.220 WARNING:teuthology.provision.fog.smithi053:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-02-19T06:24:42.140 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T06:24:46.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:46.439 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T06:24:46.439 DEBUG:teuthology.orchestra.run.smithi053:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T06:24:48.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:51.196 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T06:24:57.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:24:57.487 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T06:24:57.488 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T06:25:02.140 INFO:teuthology.provision.fog.smithi053:Node is ready 2024-02-19T06:25:02.141 DEBUG:teuthology.orchestra.run.smithi053:> hostname 2024-02-19T06:25:02.160 INFO:teuthology.orchestra.run.smithi053.stdout:smithi053.front.sepia.ceph.com 2024-02-19T06:25:02.160 DEBUG:teuthology.orchestra.run.smithi053:> grep smithi053.front.sepia.ceph.com /etc/hosts 2024-02-19T06:25:02.219 INFO:teuthology.orchestra.run.smithi053.stdout:172.21.15.53 smithi053.front.sepia.ceph.com smithi053 2024-02-19T06:25:02.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2024-02-19T06:25:02.367 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hosts 2024-02-19T06:25:02.400 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/172.21.15.53/172.21.15.53/g' /etc/hosts 2024-02-19T06:25:02.473 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i -e 's/smithi053.front.sepia.ceph.com/smithi053/g' /etc/hostname 2024-02-19T06:25:02.545 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname smithi053 2024-02-19T06:25:02.616 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-02-19T06:25:02.672 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-02-19T06:25:02.672 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-02-19T06:25:02.672 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-02-19T06:25:02.672 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:25:02.672 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:25:02.673 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:25:02.674 INFO:teuthology.provision.fog.smithi053:Deploy complete! 2024-02-19T06:25:02.675 DEBUG:teuthology.parallel:result is None 2024-02-19T06:25:17.799 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-02-19T06:25:17.799 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-02-19T06:25:17.820 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-02-19T06:25:17.821 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-02-19T06:25:17.881 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-02-19T06:25:17.882 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-02-19T06:25:18.027 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-02-19T06:25:18.057 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-02-19T06:25:18.126 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-02-19T06:25:18.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-02-19T06:25:18.260 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:25:18.315 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:25:18.316 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:25:18.316 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:25:18.316 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-02-19T06:25:18.316 DEBUG:teuthology.parallel:result is None 2024-02-19T06:25:38.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:25:41.951 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:25:47.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:25:51.040 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:25:57.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:26:00.128 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:26:06.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:26:09.212 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:26:15.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:26:18.300 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:26:24.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:26:27.356 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:26:33.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:26:36.444 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:26:42.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:26:45.504 WARNING:teuthology.provision.fog.smithi163:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-02-19T06:26:51.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:27:51.525 WARNING:teuthology.provision.fog.smithi163:timed out 2024-02-19T06:27:57.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:27:57.803 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T06:27:57.803 DEBUG:teuthology.orchestra.run.smithi163:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T06:27:58.124 INFO:teuthology.provision.fog.smithi163:Node is ready 2024-02-19T06:27:58.124 DEBUG:teuthology.orchestra.run.smithi163:> hostname 2024-02-19T06:27:58.138 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2024-02-19T06:27:58.139 DEBUG:teuthology.orchestra.run.smithi163:> grep smithi163.front.sepia.ceph.com /etc/hosts 2024-02-19T06:27:58.194 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2024-02-19T06:27:58.194 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-02-19T06:27:58.347 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hosts 2024-02-19T06:27:58.376 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/172.21.15.163/172.21.15.163/g' /etc/hosts 2024-02-19T06:27:58.444 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i -e 's/smithi163.front.sepia.ceph.com/smithi163/g' /etc/hostname 2024-02-19T06:27:58.512 DEBUG:teuthology.orchestra.run.smithi163:> sudo hostname smithi163 2024-02-19T06:27:58.578 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:27:58.633 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:27:58.634 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:27:58.634 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2024-02-19T06:27:58.634 DEBUG:teuthology.parallel:result is None 2024-02-19T06:27:58.878 INFO:teuthology.lock.ops:Checking smithi053.front.sepia.ceph.com 2024-02-19T06:27:58.878 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T06:27:58.902 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-02-19T06:27:58.902 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T06:27:58.918 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2024-02-19T06:27:58.918 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T06:27:58.936 INFO:teuthology.lock.ops:Updating [smithi053.front.sepia.ceph.com]: set os type and version on server 2024-02-19T06:27:58.936 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-02-19T06:27:58.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:27:59.039 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-02-19T06:27:59.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-02-19T06:27:59.227 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-02-19T06:27:59.281 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-02-19T06:27:59.281 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-02-19T06:27:59.336 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="CentOS Stream" 2024-02-19T06:27:59.336 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="9" 2024-02-19T06:27:59.336 INFO:teuthology.orchestra.run.smithi053.stdout:ID="centos" 2024-02-19T06:27:59.336 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:27:59.336 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="9" 2024-02-19T06:27:59.336 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:27:59.337 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:27:59.337 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-02-19T06:27:59.360 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-02-19T06:27:59.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-02-19T06:27:59.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:27:59.448 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-02-19T06:27:59.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-02-19T06:27:59.618 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-02-19T06:27:59.673 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-02-19T06:27:59.673 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:27:59.728 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:27:59.729 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:27:59.729 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-02-19T06:27:59.752 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2024-02-19T06:27:59.752 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-02-19T06:27:59.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T06:27:59.840 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-02-19T06:27:59.908 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-02-19T06:27:59.908 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-02-19T06:27:59.964 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-02-19T06:27:59.964 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T06:28:00.020 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-02-19T06:28:00.021 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T06:28:00.021 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T06:28:00.021 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T06:28:00.021 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-02-19T06:28:00.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:28:00.126 INFO:teuthology.dispatcher.supervisor:Running job 7566118 2024-02-19T06:28:00.126 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566118 --name vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/suites/fsstress}} -- /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566118/orig.config.yaml 2024-02-19T06:28:00.129 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-19_06:18:55-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7566118 2024-02-19T06:28:00.129 INFO:teuthology.dispatcher.supervisor:Job PID: 1469216 2024-02-19T06:28:00.129 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T06:30:00.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:32:00.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:34:00.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:36:00.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:38:00.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:40:01.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:42:01.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:44:01.388 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:46:01.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:48:01.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:50:01.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:52:02.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:54:02.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:56:02.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:58:02.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T06:58:02.976 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-19T06:58:03.171 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi053 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-02-19_06:41:48-rados-wip-rf-hobject-distro-default-smithi/7566248 2024-02-19T06:58:03.171 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi119 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-02-19_06:41:48-rados-wip-rf-hobject-distro-default-smithi/7566248 2024-02-19T06:58:03.171 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/rfriedma-2024-02-19_06:41:48-rados-wip-rf-hobject-distro-default-smithi/7566249